Setting the crawl charge from Google doesn’t speed up the crawling.

Google has an old Search Console feature that allows you to limit or slow down the speed at which Google can crawl your website under the crawl rate setting. This feature, as we know takes a day or so, and it won’t speed up the crawling, it may only slow the crawling of your site.

You can click on the Setting here and this is how it looks:

click for full size

As you can see, it says “limit Google’s maximum crawl rate” and not speed up the crawl rate.

John Mueller said all it does is limit the QPS, does the crawl per second mean? I think QPS usually means queries per second, but we get it.

It is best not to touch this setting if you can avoid it. Google help document says “If your crawl rate is described as” calculated optimally “, the only way to reduce the crawl rate is to make a specific request. You cannot increase the crawl rate. Otherwise, select the option you want and limit the crawl rate as requested. The new crawl rate is valid for 90 days. “

Forum discussion at Twitter.

Leave a Reply

Your email address will not be published. Required fields are marked *