When WEB Design RI performs SEO web site check the most common web site omission especially a site that was designed several years ago (Sitemaps in this format were fiorst used by Google in 2005), is the sitemap.xml file. The sitemap specifications are detailed at http://www.sitemaps.org
If you want your web site to be indexed by the major search engines and you would like the search engines to be to be notified of changes to your site then you must include a site map XML file in your web site. These files permit the search engines to crawl web sites in an intelligent fashion.
Sitemaps are what is known as a URL inclusion protocol where we notify the search engines of all of the URLs that we would like to be included when they crawl our sites and this compliments the Robots.txt files which is a URL exclusion protocol. See my Robots.txt blog entry.
Sitemaps are extremely useful on web sites which are not browser friendly and that use rich Flash or AJAX content.
Sitemaps are used by the largest search engines: Google, MSN, Yahoo, Bing and Ask.
The process is relatively simple:
1) Create an XML site map file – http://www.xml-sitemaps.com/ is a free sitemap generator tool – there are many free products like this
2) Save your sitemap.xml file to your web site root directory
3) Upload your sitemap.xml file to your web server.
4) Create a webmaster account with Google Webmaster, Bing Webmaster, Yahoo Site Explorer and upload the sitemap file.
5) This step is important and is often ignored: When you make changes, especially the addition of pages, to your website – create an updated sitemap.xml file and upload the new file to your web server and the next time your site is crawled the spiders will look for the new pages.
Sitemaps do have limits 50,000 URLs and 10 megabytes , so keep your web site to under 50,000 pages!
