‘How to Stop Googlebot from Crawling Your Site Rapidly’ – Tamar Weinberg’s Blog Post
Tamar Weinberg’s latest ‘Search Engine Roundtable’ Blog post is titled “How to Stop Googlebot from Crawling Your Site Rapidly”. [Blog]
Tamar Weinberg’s latest ‘Search Engine Roundtable’ Blog post is titled “How to Stop Googlebot from Crawling Your Site Rapidly”.
Tamar says, “A DigitalPoint Forums member is concerned about the heavy crawling performed by the Googlebot. He claims that Google is crawling 3GB of data from his site a month and wants to reduce this as it’s a bit excessive in his opinion”. How to Stop Googlebot from Crawling Your Site Rapidly…
Search Engine Roundtable Blog Link
Search Engine Roundtable Blog
Comments are closed.