Google Webmaster: How to change googlebot crawl rate?

googlebot crawl rate


Google crawler help your site by crawling on search engine. But how often Google crawler crawl your site it is not specified by Google. But you can set Google crawl rate from Google webmaster tools. In addition if you want Google to crawl immediately then you can use Fetch as Google which will work instantly. 
Google is very rich by their strong algorithm which will determine how much to crawl every site. This algorithm try with their best effort to crawl our site all pages without crushing server's bandwidth.
Remember that if Google crawl a site most often then our site server become slower. In this case changing Google crawl rate control work best that will help to increase your server bandwidth. Actually the crawl rate means the total time that use by Googlebot to crawl by the site. 
However there cause some problem in case of sub-domain. Suppose my blog address is and if I create a sub domain like http://blog.bloggerspice,com then Googlebot will cause some problem If you change the crawl rate. Because by default Google crawl very fast but in case of subdomain with custom crawl rate it is bit slower to crawl by Google. 
There are other restriction about the crawl rate for a sites, if you are trying you crawl a nonroot level domain (e.g.

Anyway now we will learn how to change the crawl rate on Google webmaster tools. Just follow the below steps-

Step 1 Go to Google Webmaster Tools and Sign in to account

Step 2 Now click on any site for controlling crawl rate (If you have more than 1 blog site).

Step 3 Click the Gear icon and then click on Site Settings.

site setting

Step 4 Under Site Settings select Limit Google's maximum crawl rate.

crawl rate

Step 5 Now more option will visible below with a scale changer option. Hold it and move right or left for changing the crawl rate.

Step 6 Finally hit the save button.

Congratulation if you followed all the above steps accurately then you have successfully changed your Google crawl rate.  The new crawl rate will be valid for 90 days. And after that if you don’t change your Google crawl rate manually after 90 days then Google will set crawl rate on default.
Google Webmaster: How to change googlebot crawl rate?
4 Stars stars - "Google Webmaster: How to change googlebot crawl rate?" Google crawler help your site by crawling on search engine. But how often Google crawler crawl...

Post a Comment

Facebook Group Community Disqus Channel Code ConverterHide Code Converter Show EmoticonHide Emoticon

Got questions? Ask ’em below! While we’re here, you might like to give any feedback about this Post, Your comment inspire us to continuous Improvement of This Blog and Contents. Your words are your own, so be nice and helpful if you can. Please, only use your REAL NAME, not your business name or keywords. Using business name or keywords instead of your real name will lead to the comment being deleted. Anonymous commenting is not allowed either. Limit the amount of links submitted in your comment. We accept clean XHTML in comments, but don't overdo it please.

Make sure you tick the Notify Me box below the comment form to be notified of follow up comments and replies. Thank you for commenting

Contact Form


Email *

Message *