This is an XML file. We make it for search engine crawlers. We put here those urls which you want to index on the search engines.
|Sitemap Header||<?xml version=”1.0″ encoding=”UTF-8″?>||We specify here xml sitemap version and encoding UTF-8||Mandatory|
|URL Set||<urlset>||Show all urls info here||Mandatory|
|URL||<url>||Show single url info||Mandatory|
|URL Location||<loc>||Put here page url.||Mandatory|
|Change Frequency||<changefreq>||How frequently the page is likely to change||Optional|
|Last Modification||<lastmod>||It is a Last Modification Date of the page.
|Priority||<priority>,||The priority of this URL relative to other URLs on your site. Valid values range from 0.0 to 1.0.||Optional|
Lets see some important XML Sitemap Rules:
Google ignores priority and Change frequency meta data (attribute). You can remove it from the sitemap.
Don’t include session IDs from URLs in your sitemap to reduce duplicate crawling of those URLs.
Put your sitemap in root directory of your html host, For example ‘web’, ‘www’ or ‘public_html’. Make sure sitemap is opening publicly.
File size should be maximum 50 MB or You can add 50,000 URLs in a single sitemap. (including any urls like image, video, alternate urls).
– You can compress the xml sitemap in GZip format. It can speed up the crawling.
– Experts recommends that we should add maximum 10-20K urls per page.
Search engines cannot read urls which have special characters. To avoid this, use encoded urls.
You can use any valid file name for your xml sitemap url. There are no restrictions.
For compressed file
If you have a big website. You can break your list into multiple sitemaps. Webmasters and robots.txt accept this file too.
XML Sitemap Index Format Example
Image XML Sitemap Format Example
You can also add images, video, news and other format urls in the xml sitemap but the format is different for it as compare to normal url sitemap.
For example: (Image
You can add maximum 1000 images within a single url. CDN (other domain) images are also allowed.
News XML Sitemap Format Example
Video XML Sitemap Format Example
If you have separate mobile urls, other language/region urls in your website then specify them in the sitemap.
There is no direct impact on Google ranking. It just helps to crawl your website’s all pages. You delete your xml sitemap or change urls in the sitemap, no impact on ranking.
Even you have small website with good navigation, you don’t need to have a xml sitemap.
You must use if complex and big website and having an issue in indexing and crawling or not having all url links in the website.
There are three types to generate xml sitemap.
If you want to speed up deindexing of urls, you can add these urls temporarily in xml sitemap. Google deindex them more frequently than other methods.
We should tell to search engines about mobile version urls so they can index them easily.
There is no problem, if your sitemap indexed by google but you feel to remove it due some other reason like you don’t want to see your pages to competitors then how we can hide these xml sitemap files/pages from google. let’s see…
First, how to check website xml sitemap files which have been indexed by Google.
Just type on google this formula
Here you can see all indexed xml sitemap files
Just add noindex in http header response, we also call it X-Robots tag
HTTP/1.1 200 OK Date: Tue, 25 May 2010 21:42:43 GMT (…) X-Robots-Tag: noindex (…)
Just login your google webmaster account and open sitemap report
You can get one more sitemap data from the coverage report > All submitted pages (select it from the top).
Here you can see all crawl errors, valid urls and exclude urls with details.