Tell the Google Bots Where To Go!

Lazy Bot

site map with links

 

When I discussed Webmaster Tools earlier, I mentioned the need to create a sitemap for your website and submit it to Google.  I will discuss how to do the creation and submission of a site map in this post because it is critical to the indexing of your website by Google and determines how your website will be found through search queries on Google (and other search engines).

A sitemap is basically, as the name suggests, a map or directory of your website, so that the structure and priority of the files on your website can be displayed for easy access by the search engines.   You can see from the sitemap extract above that the sitemap for Small Business Odyssey has a hyperlinked list of files, a priority rating (percentage) and a frequency rating (to tell the search engines how frequently to index that part of the website).  

Why create a sitemap and why submit it to Webmaster Tools?

Lazy BotWell, in non-technical language, it seems that the Google Bots (robots that crawl your website) are lazy ‘creatures” and do not go out of their way to properly index your site for the Google search engine.  They take the easy way out – they only go where the path is clearly laid out for them.  They don’t like deadends (broken links) or confused pathways (disconnected files randomly located).   When I look at how Google is currently indexing my Small Business Odyssey blog, I am even more convinced of how lazy the Google Bots are – it seems that they need to be spoon-fed the information, otherwise they do a poor job of indexing your website.

So the primary reason for creating a sitemap for Google is to enable the Google Bots to comprehensively index your website.   Otherwise, a lot of your website may not appear in Google’s index and will not be found by Internet searchers.  Google admits as much by this comment on Webmaster Tools:

Submit a Sitemap to tell Google about pages on your site we might not otherwise discover.

Creating an XML Sitemap

This brings us to the creation of a sitemap.  I am suggesting that you create this sitemap initially as a .XML file because it is easy for the lazy Bots to read completely.  This sitemap format basically lets the Google Bots into the back engine room of your site and shows them around – where files are located and how they are linked by type (home page, static pages, dynamic pages, categories, tags).

If this post appears too technical for you, just make sure that your Webmaster has created an XML sitemap for your website and submitted it to Google.  

Here are the steps for creation of your XML sitemap:

  1. Download the free WordPress Plugin for the Google XML Sitemap Generator.
  2. Upload the XML Sitemap Generator to your website (via your WordPress Admin panel)
  3. Make adjustments to the default settings (if you wish)
  4. Click ‘create sitemap’ and you will very quickly have a site map and a stated location (URL) for your sitemap.

The beauty of this WordPress Plugin for creating Google XML Sitemaps is that it offers multiple options in terms of settings, automatically submits the sitemap to Google, Ask.com and Bing search engines and updates automatically when you change a file on your website.  So it is comprehensive and dynamic.

In terms of adjustments to default settings, most commentators suggest that you leave the defaults as they are – it certainly makes life simpler.  However, I would suggest that you may want to change the default for ‘priority’ – the default setting tells the Google Bots to give priority to the posts that have the most comments.  This may not be meaningful if you have a really new site.  I have set up my priorities in the following order –  home page, recent posts, static pages, older posts, categories and tags.  I will change this as the Small Business Odyssey site becomes more established and generates more traffic and comments. 

The other default setting you may want to change before you click the “create sitemap’ button, is ‘Change Frequency’. For example, the default setting tells the Google Bots to index your posts weekly.   However, if you are creating blog posts on a daily basis, you should change the ‘frequency’ to daily.  The Google Bots may ignore this suggestion (remember they are basically lazy), but it is better to at least express your wishes.  Google’s own experts, such as Matt Cutts, tell us that the more frequently you update your site with relevant information, the more often the Google Bots will crawl your site and the deeper (more thoroughly) they will index your website.

I’ve made a few adjustments to the priority and frequency default settings for my XML sitemap and you can see the result here:

http://smallbusinessodyssey.com/sitemap.xml

Here’s a YouTube video that simplifies the whole process and shows you exactly what to do (there are no adjustments to defaults and the WordPress Plugin is downloaded directly to the Admin panel via the built-in Plugin search facility): 

 

How to submit your XML sitemap to Google’s Webmaster Tools 

You might wonder why we need to do this extra step as the WordPress XML Sitemap Generator automatically submits your sitemap to Google (and to Bing and Ask.com).  Well, I think it comes back to our lazy Google Bots again – they don’t go out of their way to find the sitemap, so you have to put it in front of them!   If you check out the screenshots below, you will also see how Google takes up the information from the sitemap on Webmaster Tools and begins to integrate it into its index.  So submitting the sitemap to Google’s Webmaster Tools is a way to get direct access to Google’s index (although it may take some time for all of the information to be indexed).

The process of submission of your sitemap to Google’s Webmaster Tools is very simple:

  1. log in to your Webmaster Tools site
  2. click on the web address (URL) for your verified website 
  3. click the ‘site configuration’ menu item
  4. click the ‘sitemaps’ menu item
  5. enter your sitemap address where indicated (see image below).

  sitemap submission to webmaster tools

When you first submit your sitemap, the above image will appear with the messages ‘submitted URLs – O’ and “index count pending’ (and status shown as ‘in progress’).   Take heart, this is Google trying to identify all your files from the sitemap and integrating them into their index.   After some processing time, you will see the following image that indicates successful submission:

Google indexing sitemap on Webmaster Tools

So this indicates that Google has taken on board your website pages (URLs) and has loaded them into their index.  The actual indexing in terms of search terms (keywords) will occur over an unspecified period (you can’t rush the Google Bots).

Creating and submitting an XML sitemap to Google’s Webmaster Tools is critical for small business marketing because it ensures effective indexing of your website so that Internet searchers can find your website through your targeted search terms (keywords).

What If You Don’t Like the Search Queries Results You Are Getting?

search queries webmaster tools

search queries webmaster tools

In a previous post, I discussed how to register with Google’s Webmaster Tools and how to identify the results for search queries that bring people to your website.   The search queries results may not be what you were expecting and may, in fact, be quite disappointing.  So why would this be, given all the hard work you have put into writing content for your site?

The search queries results provide invaluable data about your site and how it is viewed by Internet searchers.   Before you do anything else, just check the filters (e.g. geography) that you have used to report the data.  It may be that you have excluded a search query from your results because of the filters you have used in reporting the search queries results.

One of the core reasons that your search queries results will differ from your expectations is the relevance of both your content and your site description.

How to improve your search queries results in Webmaster Tools

Let’s focus on relevance because that is the key issue determining whether your site gets included in Google’s search queries results for a particular query.

It may be that Google has not been able to find enough content on your site that is both useful and relevant to Internet searchers who have used a particular search query.   If you are unfocused on your site, trying to cover multiple topics or unrelated topics, both Internet searchers and Google will be confused.  As I mentioned in an earlier post, focus is so critical to your online results and your small business marketing success.

So here are some hints to improve the relevance of your content:

  • Focus on your reader – what is their level of understanding of what you are discussing on your site?
  • What language do your readers use to describe their problems/issues? – you can outpace your reader with your own understanding of a particular issue
  • Find out where your customers are conversing – join in the conversation
  • Be conscious of your marketing style, particularly if you are in the coaching or consulting business
  • Check out Google AdWords Keyword Tool to see what terms people are using to search for information in your niche area – you will often be surprised! (make sure you sign in with your Google account details to get more complete results)
  • Visit blogs that are related to your niche to see what topics people are discussing, the language they are using and the problems/issues they are experiencing (take particular note of the blogs that have lots of comments)
  • Put yourself in your reader’s shoes – what would you be experiencing?, what kind of help would you need?, what would you be talking about?
  • Check out your site’s description as it appears on the Google search queries results – is your site description relevant to what you write about? (if not, change your site’s ‘description meta tag’ or get someone to change it for you).

Just focusing in on the relevance of what you write, and how you write, can go a long way to improving your search queries results.

Do You Know How People Find Your Website on Google?

webmaster tools - menu

webmaster tools

 

Google’s Webmaster Tools (GWT) show you clearly how Internet users find your website through Google’s search results.  You can learn, for example, what search terms result in your site being displayed and which of these are the top queries for your website. 

Registering with Google Webmaster Tools and verifying your website

You need to visit Google’s Webmaster Tools site and sign in using your Google account.   This is the image you will see when you visit the site:

Google Webmaster Tools

Just click on the ‘Sign in to Webmaster Tools’ button and follow the instructions to enter username and password.  Once you are on the site, you will see a button, ‘ADD A SITE’ and you will be able to add the web address (URL) of your website.  

Before any results are reported, you will need to verify that you are the owner of the website.  Google Webmaster Tools explains how to do this and one of the options is to copy a verification file to your website (so that Google can check that you actually have Webmaster rights/access to the site you listed). 

Once you are verified, you will then need to be patient as Google takes some time to crawl your site and start reporting results.  I would give it a few days if you want to get anything meaningful.  The Google bots take holidays too – they don’t visit your site every day (unless your site is a really top ranked site or is updated daily and you let Google know about it).

What the Webmaster Tools tell you about how people find you in Google search results

Webmaster Tools provides information to show you how your site is seen on the web – it covers search queries, links to your site, keywords, internal links and subscriber statistics.  This information is accessible via the left hand menu:

 webmaster tools - menu

What I want to focus on in this post, is the ‘search queries’ information and its implications.   If you click on “search queries” in Webmaster Tools, you can find out valuable information about your website: 

  • Queries: the total number of different search queries in Google that resulted in your site being displayed; this is the number of search terms that generated a listing of your site in Google’s search results (for the period you specify). 
  • Query: a search term used by an Internet searcher that resulted in your website being listed in the Google search results; Google lists the top search terms (in descending order of frequency) that result in your website appearing in Google’s search results. 
  • Impressions:  the number of times one of your web pages appears in the Google search results for viewing by someone who searches on Google; Google gives you the total number of impressions ordered by query, along with the percentage change over the previous period.  
  • Clickthrough Rate (CTR): how many times your website impressions (appearances in Google’s search results) produced a click; Google expresses the clickthrough rate as a percentage (number of clicks as a percentage of number of impressions). 
  • Average Position: what position on the search results your website appeared at for a specified query; Google expresses this as an average position and shows the change in terms of ‘+’ or ‘–‘ the number of positions (improvements in position are shown in green). 

So through the Webmaster Tools you can learn the total number of Google ‘queries’ that resulted in your site being displayed.  You can establish what Google search queries were used to locate your site and which of these search terms generated the most traffic.  You can also establish which search terms resulted in the most clicks.   The other valuable piece of information is your average page rank for a particular query (which will impact heavily on your impressions and clickthrough rate). 

In the following diagram, I show how Google illustrates these results (this is the result over two days for my new site, a day after I registered the site on Webmaster Tools):

 

 webmaster tools - top queries

 

To access this representation of your search queries results, you click on ‘more’ at the end of your ‘query’ listing and the illustration will appear.  The image above is for ‘top queries’ and the illustration below is for ‘top pages’ (you can choose these options by using the tabs at the top left).

 webmaster tools - top pages

At the top on the left hand side, there is a button ‘Filters’ that allows you to set parameters for the displayed information, e.g. by geography.

Mining the riches of Webmaster Tools

There is a lot more to Google’s Webmaster Tools than at first meets the eye.  As you go deeper into this Google tool, you can find a rich store of information that can help your site get indexed better by Google, crawled more often by the Google bots, displayed more frequently in search results and visited more often – it’s up to you to tell Google what you want. 

In subsequent posts, I will explore some of the things that you can do based on other information that is available in Google’s Webmaster Tools:

  • What to do if you don’t like your search query results shown on Webmaster Tools
  • How to improve Google’s indexing of your targeted keywords
  • How to improve backlinking for your website
  • What to do to create more internal links
  • How to create and submit a sitemap
  • What to do about Google’s diagnosis of your website.

These topics alone demonstrate how important it is to use the Webmaster Tools  to understand how people find your site on Google and how Google actually ‘sees’ your site.

Free WordPress Plugin: podPress Audio Player for Podcasts

podPress

podPress

podPress is a free WordPress Plugin that enables you to install an audio player in your blog post.  Visitors to your blog are then able to play the podcast directly on your blog.

The key thing is that you have control over where the audio player is located so that you can ensure it is near a relevant comment or resource.  All you have to do is insert a simple piece of code in your post where you want the media player to display and podPress does the rest.

podPress does a range of things that are particularly useful for small business marketing:

  • acts as an automatic media player for videos as well as audios
  • allows listeners to control the player
  • facilitates download of the podcast
  • provides stats on downloads (including graphs)
  • generates RSS (and ATOM) feed and submits feed to iTunes (on publication).

So this free WordPress plugin enables you to readily display a media player for your audios or videos as illustrated below:

[display_podcast]

 

When someone clicks on the play button, the audio player image expands to show the progress of the podcast and to enable the listener to pause the player:

podpress wordpress plugin

How to create your audio player with podPress

Once you have installed the free WordPress Plugin, you need to advise the podPress plugin of the location and details of your podcast file.  Some of these details can be completed by using the “auto detect” button provided against the relevant field, others are completed automatically by the plugin.  The screenshot below shows the fields that need to be completed either by yourself or automatically by the plugin:

 

podcast file descritpion for podPress

podPress also provides a number of fields so that you can specify the relevant details for inclusion of your podcast in iTunes.  However, you can override this option if you have some other method of syndicating your podcast.

podpress is a solid free WordPress Plugin that enables you to stream audio or video on your site and simultaneously broadcast your podcast to iTunes.

iTunes: How to Avoid a Green Screen in Your Video

Green video screen with iTunes

Green video screen with iTunes

For the last few weeks I have been frustrated by a green screen showing on iTunes when I attempt to view a high quality video.   I have been getting audio but no picture apart from an annoying green screen.

I searched the Internet and found many other people were having a similar problem.  Most of the responses to the question, “How do I remove the green screen when I play my videos on iTunes?”, were highly technical.  On one particular site, the technical experts were arguing amongst themselves about what was the best method or who had the best solution.  I found most of the responses somewhat bewildering and confusing.

Green screen on iTunes – a question of codecs?

A codec is the software that video players use to create (compress) a video or play (decompress) the video.  Some video players (such as iTunes) have both kinds of codecs – for creating and playing videos.

It seems that one of the fundamental problems is that the codecs that have been developed for creating videos are outpacing the codecs incorporated in iTunes.   As video creation becomes more and more sophisticated and higher quality, sites that provide video players have to decide how advanced they should make their video players and what level of codecs to employ [the parallel in computing is, “Do you move to Windows 7 or do you stick with Windows XP and put up with conversion problems?].

Some experts in the field suggest you work out the codec you require and download it. Microsoft itself discourages this practice and warns against the the dangers of this action:

Warning

Use caution when installing codecs that you find on the Internet, particularly some of the free codec packs that claim to include codecs from a wide variety of companies or organizations. Incompatibilities are known to exist with some of the components in these codec packs that can cause serious playback issues in the Player and other players, lead to system corruption, and make it difficult for Microsoft Support to diagnose and troubleshoot playback issues.

So what should you do to get rid of the green screen in iTunes videos?

The solution: AVS Video Converter

Finally, after weeks of searching and reading, I have found a simple solution that serves multiple purposes – the AVS Video Converter.  What this effectively does is take a video that uses one set of codecs (such as MP4, usually playable on iTunes) and converts it to a video that uses a different set of codecs (such as WMV, playable on Windows Media Player). 

The besuty of this software, AVS Video Converter, is that you get to choose the final output from a range of options provided.

AVS Video Converter Contol Panel

The software is very easy to operate and very reasonably priced.  Here’s a screen capture of the control panel:

avs video converter

You can see across the top, the options for the output (e.g. AVI, DVD, MP4, MPEG, WMV, etc).  All you have to do is highlight the video output type you want, browse your computer to select your video file and specify the folder for the converted video.   The AVS Video Converter retains the high quality of the original video.

You are able to monitor the planned conversion (before pressing the “CONVERT” button) by pressing the “Advanced” button and the resultant display will show full details of the input and output files (with the relevant video codec identified).

 

avs video converter

 

You can monitor the quality of the video as it is being produced by clicking on the arrows beside the “Advanced” button.  You will be able to see “Elapsed” (time taken so far to convert the video), “Remaining” (time required to complete the conversion) and “Overall Progress” (percentage of video conversion).   The blue bar shows visually where the video conversion is up to.   The monitoring screen will also display the image relevant to the location in the video conversion:

 

avs video converter

 

Well, the AVS Video Converter solved all my problems with the green screen on iTunes and I converted six videos the day after I purchased the software.

AVS Video Converter:  70% off Sale until 30 November 2011

  AVS Video Converter - 70 % off

The award-winning AVS4YOU software, including the AVS video converter,  is normally offered on an annual fee basis for the whole suite of 18 programs (listed below).  For the month of November 2011, this whole suite of 18 programs is being offered at 70% off for unlimited access (and download) – Price $59.

AVS – Unlimited Access to 18 Software Programs

This offer includes free updates and free support.  Here are the 18 software programs in this unbelievabe offer:

AVS software programsIf you want to remove the green screen from videos on iTunes then the AVS Video Converter is the answer – but why not take advantage of the great offer for unlimited access to the whole suite of AVS software programs (while it is on offer in November)?