wiseseo:~/news/mueller-shrinking-site-wont-fix-not-indexed $

date
category
[CRAWLING]
impact
HIGH
status
STATEMENT
read
4 min

Mueller: shrinking a site will not fix a mass not-indexed problem

John Mueller says a large not-indexed share usually means Google doubts the site's quality, and cutting pages will not raise it.

On 10 November 2026, John Mueller of Google was asked a familiar question on Bluesky. Toren Ajk wanted to know what to do when a site consistently shows a large share of pages as "Crawled - currently not indexed" or "Discovered - currently not indexed" in Search Console: noindex them, redirect them, wait, or try something else.

Mueller's answer, posted at 20:51 UTC, was blunt. "Usually this is a sign that Google's quality systems are unconvinced about your site (or convinced in the way that you don't want). Just making the site smaller doesn't significantly raise the overall quality of the site."

About 40 minutes later, Ajk asked whether that meant building trust signals mattered more than optimizing crawl budget. Mueller refused the trade-off: "I think those are very distinct things. If a tiny number of your sites pages are indexed, that suggests either a severe technical issue ("crawl budget" - which you would definitely notice at that scale), or that Google just isn't convinced about your site overall."

Those comments sit next to help-page wording that never mentions quality. The current entry for "Crawled - currently not indexed," which we fetched from the Page indexing report documentation, says Google "doesn't index all pages across the web, so this is a common message for many sites and doesn't necessarily indicate an issue that needs attention." For important pages, it tells owners to use the URL Inspection tool and look for site-side problems, "such as if you've blocked them from our crawlers."

The two tones are less of a contradiction than a split in purpose. The help page is triage: a large not-indexed count is common, and most of those URLs may not deserve a fix. Mueller is answering a different question, about a site that consistently cannot get a large share of its pages into the index. In that case, he says the usual cause is a quality judgement, and that noindexing or redirecting the rejected URLs to "make the site smaller" does not, by itself, change that judgement. Search Engine Roundtable, writing the next morning, noted that this is not a new position from Mueller.

He drew a related line the same week. On 9 November at 05:36 UTC, in a thread about a fairly new site whose "Request indexing" attempts were failing, Mueller advised "focusing on normal crawling and indexing." "It's a fairly new site, and you've been busy with content - it can take time for the systems to understand the unique value of it all, so it's good to make sure it's really top notch (quality over quantity)." The next day, in a separate thread, he added: "If you don't want something indexed, then noindex is fine." That remains the right tool for URLs you do not want in Search. It is not a lever for raising the quality of the URLs you do want indexed.

Two other distinctions are easy to blur. Mueller did not treat a non-zero not-indexed count as a crisis; the help page still calls that common. And "Crawled - currently not indexed" is not the same as "Discovered - currently not indexed," which the help page describes as a URL Google found but has not crawled yet, typically because it expected the crawl to overload the site.

what to do

  • In Search Console, open the Page indexing report and export "Crawled - currently not indexed" and "Discovered - currently not indexed" separately. A discovered URL with a blank last-crawl date is a fetch-timing or capacity issue, not the quality situation Mueller was describing.
  • Do not start with a mass noindex, a bulk redirect, or a cull of the not-indexed list in the hope that a smaller site will be judged more favourably. Mueller said that does not significantly raise overall quality.
  • Split the crawled-not-indexed list into URLs that should be earning traffic and URLs that should never have been candidates. Only the first group needs work, which is also what the help page asks you to inspect.
  • Run URL Inspection, including a live test, on those important URLs. Confirm Google can fetch them, that the crawled and rendered HTML contains the page's own content, and that nothing in robots.txt, a noindex tag, a redirect, or a canonical is sending Google elsewhere. Check the last crawl date and the Google-selected canonical.
  • If only a tiny share of the site is indexed, look for a site-wide technical failure first. Under Settings, open Crawl stats and look for a collapse in crawl requests, or a spike in 4xx, 5xx, or robots.txt blocks, around the period indexing stalled.
  • If fetches succeed and important pages still sit at crawled-not-indexed, treat it as a quality and uniqueness problem and improve the pages you want indexed, rather than looping Request indexing.

refs

  1. [1] John Mueller on Bluesky: making a site smaller does not raise overall qualityhttps://bsky.app/profile/johnmu.com/post/3mzycywr5vs26
  2. [2] John Mueller on Bluesky: crawl budget and quality are distincthttps://bsky.app/profile/johnmu.com/post/3mzyf65qucc26
  3. [3] John Mueller on Bluesky: new sites and unique valuehttps://bsky.app/profile/johnmu.com/post/3mzu7fu2xbc2f
  4. [4] John Mueller on Bluesky: noindex is fine for pages you do not want indexedhttps://bsky.app/profile/johnmu.com/post/3mzxcdqr5sk26
  5. [5] Page indexing report (Search Console Help)https://support.google.com/webmasters/answer/7440203
  6. [6] Google Crawled/Discovered - Currently Not Indexed A Site Quality Issuehttps://www.seroundtable.com/google-crawled-discovered-currently-not-indexed-42507.html