Google: Noindexed Pages Do Not Impact Crawl Budget

Posted by

Google’s Browse Relations group validates that noindexed pages do not negatively impact a site’s crawl budget plan, no matter the number of a website has.

This topic is addressed not as soon as however thrice during the November 2022 edition of Google’s SEO office-hours Q&A session.

Google Browse Supporters John Mueller and Gary Illyes take turns addressing three comparable concerns from individuals concerned they have too many noindexed pages on their websites.

From Mueller’s and Illyes’ responses, we find out there’s no such thing as “a lot of” indexed pages. Further, unless your site has more than a million pages, there’s no requirement to stress over crawl spending plan.

Here’s a quick recap of each concern and response.

Concern 1: Excessive Indexed Pages

At the 8:23 mark in Google’s November 2022 office-hours, Illyes addresses a concern asking if an “excessive” variety of indexed pages is a concern for discovery or indexed.

Illyes says noindex is a tool to help websites keep material out of online search engine. Google motivates using the noindex tag when needed, and for that reason, there are no adverse effects related to it.

“Noindex is an extremely powerful tool that online search engine support to help you, this site owner, keep material out of their indexes. For this reason, it doesn’t carry any unintentional effects when it comes to crawling and indexing. For example, having numerous pages with noindex will not influence how Google crawls and indexes your website.”

Question 2: Ratio Of Indexed/Noindexed Pages

The following concern turns up at the 10:22 mark:

“Should we keep an eye on the ratio between indexed and non-indexed pages in Browse Console in order to much better recognize potentially squandered crawl spending plan on non-indexed pages?”

Mueller unmasks that websites need to attempt to stabilize their indexed and nonindexed pages.

To that end, crawl budget plan is an element that few websites need to think of; Mueller states:

“No, there is no magic ratio to watch out for. Also, for a website that’s not gigantic, with less than a million pages, maybe, you really do not require to fret about the crawl spending plan of your site. It’s great to eliminate unneeded internal links, however for small to medium-sized sites, that’s more of a site health topic than an SEO one.”

Concern 3: Noindexed Pages Linked From Spammy Sites

At the 11:26 mark, a concern shows up about no indexed pages that’s somewhat various from the previous 2.

The question checks out:

“A great deal of SEOs are grumbling about having millions of URLs flagged as excluded by noindex in Google Browse Console. All to nonsense internal search pages connected from spammy sites. Is this an issue for crawl spending plan?”

Ilyes repeats the earlier point about noindex being a tool for websites to utilize as needed.

Presuming the pages are intentionally noindexed, there’s no requirement to stress over Browse Console flagging them. It does not mean you’re doing anything incorrect.

Illyes states:

“Noindex exists to help you keep things out of the index, and it doesn’t included unintentional unfavorable results, as we said formerly. If you want to ensure that those pages or their URLs, more specifically, do not wind up in Google’s index, continue using noindex and don’t fret about crawl spending plan.”

Source: Google