Crawled vs Discovered: Are these two non-indexed statuses really the same thing?

This statement from John Mueller debunks a widespread belief: no, moving from 'Discovered' to 'Crawled' doesn't necessarily bring your URL closer to indexation. Google operates by priorities — crawling a page doesn't mean it deserves a place in the index.

Many SEOs still think a crawled URL has crossed a decisive threshold. Wrong. Crawling is mere information gathering; indexation is an editorial decision based on the perceived value of the page.

What does 'equivalence' between these two statuses really mean?

Concretely, both labels indicate the same thing: Google knows the URL, but doesn't judge it worthy of serving to users. Whether the URL was crawled or simply discovered via a link, the final outcome is identical — it stays out of the index.

The 'Crawled, not indexed' status means that Googlebot fetched the content, analyzed the HTML, extracted signals — and concluded it wasn't worth it. 'Discovered, not indexed' means Google spotted the URL (via sitemap, internal links, backlinks) but didn't even deem it necessary to allocate crawl budget to it.

Why does Google decide not to index these pages?

The reasons are multiple and Google deliberately remains vague. It could be duplicate content, low-value pages (filters, infinite pagination, empty archive pages), lack of site authority, or simply saturation: Google can't index everything.

In some cases, it's a problem of poorly allocated crawl budget. Google spends time on useless URLs while good pages stay ignored. In others, it's structural: too many similar pages without differentiated value.

• 'Crawled, not indexed': Google looked, judged the content, and said no
• 'Discovered, not indexed': Google knows the URL exists but won't even spend resources on it
• The equivalence: both lead to the same result — no organic visibility
• The real issue: understanding why Google refuses indexation, not which status the URL is stuck in

Is this statement consistent with real-world observations?

Yes — and it's frustrating for many SEOs who hoped crawling means 'almost indexed'. In the field, we regularly observe sites with thousands of crawled URLs never indexed, while others see discovered URLs move straight to the index after a simple mention in a sitemap.

What really matters is the perceived quality of the page. Google doesn't lack crawl budget — it lacks valid reasons to index mediocre content. If your page brings nothing new, it can be crawled a hundred times without ever entering the index.

What nuances should be added?

Pay attention: if Google never crawls a discovered URL, that's also a signal. It could indicate a structural problem (misconfigured robots.txt, chaotic pagination, non-crawlable JavaScript) or lack of authority so severe that Google considers crawling a waste.

Conversely, a crawled then rejected URL means Google took the time to analyze and concluded negatively. That's worse than simply 'not yet crawled' — it's active rejection. [Needs verification]: Google claims both statuses are equivalent, but in practice, a crawled then rejected URL often requires more work (rewriting, consolidation) than a simply ignored URL.

In which cases doesn't this rule apply?

On sites with very high authority, some URLs move directly from 'Discovered' to 'Indexed' without ever showing 'Crawled, not indexed' status. Google trusts by default then. It's rare, but observable on established media or university sites.

Another exception: voluntarily blocked pages (noindex, canonicals pointing elsewhere). They sometimes appear as 'Discovered, not indexed' when it's a deliberate webmaster choice. Google doesn't make the distinction in Search Console — it's up to the SEO to sort it out.

What should you do concretely facing these statuses?

First step: identify pages that truly deserve indexation. Not all URLs on your site are meant to be indexed. Faceted filters, empty archive pages, minor content variations — forget them.

For strategic pages stuck in these statuses, two levers: improve the content (added value, originality, depth) and strengthen relevance signals (internal links, external mentions, semantic context).

What mistakes should you avoid?

Classic mistake: multiplying manual indexation requests via Search Console. If Google refuses to index after crawl, it's not a bug — it's a choice. Forcing won't change anything.

Another trap: believing an XML sitemap guarantees indexation. The sitemap is a suggestion, not an order. Google crawls what it wants, when it wants, according to its own value criteria.

How do you diagnose and fix the problem?

Analyze patterns: which page categories are blocked? Filters? Deep pagination? Old articles with no backlinks? Once the pattern is identified, three possible strategies:

• Consolidation: merge similar pages into one richer version
• Voluntary noindex: accept that these pages don't need to be indexed and clean up Search Console
• Enhancement: enrich content, add media, create targeted internal linking, earn backlinks
• Canonicalization: point variations to the main version to concentrate signals
• Structural revision: rethink pagination, filters, hierarchy if the problem affects hundreds of URLs