Google webmaster central blog has answered some questions on Googlebot.


Google Webmaster Central blog has answered some questions on Googlebot.

The questions answered by Google Webmaster Central blog include:

– ‘If my site is down for maintenance, how can I tell Googlebot to come back later rather than to index the ‘down for maintenance’ page?

– What should I do if Googlebot is crawling my site too much?

– Is it better to use the meta robots tag or a robots.txt file?

– If my robots.txt file contains a directive for all bots as well as a specific directive for Googlebot, how does Googlebot interpret the line addressed to all bots?’

Post Related Link

Read Google Webmaster Central Blog Post