Google Says 100,000 URLs Won’t Impact Crawl Budget

Google’s John Mueller said a site with 100,000 URLs usually won’t be enough to impact crawl budget. Your site and number of pages should be larger to where you might run into an issue with Google’s crawl budget.

John said this on Twitter “100k URLs is usually not enough to affect crawl budget (it’s in 2016 that a site with 100,000 URLs may see a benefit of using nofollow on internal links for crawl budget purposes – keep in mind, that was five years ago.

Here are the tweets in context with what John Mueller said:

Hope this thread helps some SEOs.

Forum discussion at Twitter.

You May Also Like

About the Author: admin

Leave a Reply

Your email address will not be published. Required fields are marked *