Muhammad Basim
Pin for Why Isn't My Page Indexed? A Diagnostic
SEO

Why Isn’t My Page Indexed? A Diagnostic

Muhammad Basim
Muhammad Basim
·10 min read

✦Part of the comprehensive guide on: Technical SEO: What Actually Breaks Rankings

Why Isn't My Page Indexed A Diagnostic

A page is not indexed for one of three reasons: Google cannot reach it, Google will not store it, or Google has chosen a different URL to represent it — and Search Console tells you which, in a status most people misread.

The most common status of all, "Crawled — currently not indexed," is one that Google explicitly says needs no action. A large share of the effort spent on indexing problems goes into that one, which is why the status list is worth decoding properly before touching anything.


Every status, decoded

Straight from Google's own definitions, sorted by what you should actually do.

Something is broken — fix these

Status What it means Fix
Server error (5xx) Your server returned a 500-level error to Googlebot Check host status and crawl stats. Often load-related
Redirect error A chain too long, a loop, or a bad URL Trace and flatten the chain
Soft 404 A "not found" page returning HTTP 200 Return a real 404, or add genuine content
Blocked due to unauthorized request (401) Googlebot was asked to authenticate Remove the authentication or allow Googlebot
Blocked due to access forbidden (403) The server refused Googlebot Allow non-authenticated access
Page indexed without content Google indexed it but could not read it Usually a rendering or cloaking issue

Working as intended — leave these alone

Status What it means
Alternate page with proper canonical tag Google says: correctly points to the canonical page, "nothing you need to do"
Page with redirect A non-canonical URL redirecting somewhere else. Expected
Not found (404) Only worth fixing if you linked to it or submitted it
URL marked 'noindex' Doing exactly what you told it to. Only a problem if unintended

These four make up the bulk of most sites' "not indexed" totals, and every one of them is normal. A large not-indexed number is not by itself a problem — the reasons are the data, not the total.

Wait — Google says no action needed

Status Google's own guidance
Crawled — currently not indexed "The page was crawled by Google but not indexed. It may or may not be indexed in the future." No action required; resubmission is not necessary
Discovered — currently not indexed "The page was found by Google, but not crawled yet." Google rescheduled the crawl. No resubmission needed

Decide — these need a judgement call

Status What it means What to do
Duplicate without user-selected canonical Google picked a different page as canonical and will not serve this one Either set an explicit canonical, or make the content substantially different
Duplicate, Google chose different canonical than user You set one; Google overrode it Check whether the pages really are near-duplicates. Google is often right
URL blocked by robots.txt A robots rule is blocking it Intended or not? See robots.txt mistakes
Indexed, though blocked by robots.txt Indexed anyway, because others link to it This one is important — see below

The two statuses everyone misreads

"Crawled — currently not indexed"

Google looked at the page and decided not to store it. That is the honest translation, and Google's own advice is that no action is required.

It usually means one of:

  • The page is thin or near-duplicate — genuinely, not by some tool's word count rule
  • It is one of many similar pages, and Google has kept a representative sample
  • Your site is new, and Google is being conservative until it has more signal
  • The page is orphaned — nothing internal links to it, which reads as "even this site does not think it matters"

The last one is the most fixable and the most overlooked. Before anything else, check whether the page has internal links pointing at it from pages that are indexed. A page reachable only from a sitemap is a page nothing votes for.

What does not work: repeatedly requesting indexing. It does not change the assessment, and Google says resubmission is unnecessary. What does work: making the page materially better, or linking to it properly from pages that already have standing.

"Discovered — currently not indexed"

Google knows the URL exists and has not got round to fetching it. On a small site this is usually temporary. At volume it means Google is rationing attention to your site — and the causes are typically server slowness under crawl, or a large number of low-value URLs competing for the same budget.

If this status covers thousands of URLs, the problem is usually URL bloat rather than the individual pages — parameters, filters, pagination and tag archives multiplying one page into many.


The status that proves robots.txt is not an indexing control

"Indexed, though blocked by robots.txt" is worth understanding because it contradicts what most people believe.

Google's own explanation: the page was indexed despite being blocked, because Google "always respects robots.txt, but doesn't prevent indexing if someone else links" to the page.

So a disallowed page can appear in search results — without a description, because Google was never allowed to read it, but present. Google's advice is explicit: use noindex rather than robots.txt if you want a page kept out.

And the trap that follows: if you disallow a page and put noindex on it, Google cannot see the noindex, because it is not allowed to fetch the page. The two directives cancel out, and the page stays indexed. The full failure mode is in robots.txt mistakes that de-index whole sites.


The diagnostic order

Six steps. Stop when you find the cause.

Step 1 — Run URL Inspection on the specific URL

Search Console will tell you the indexing status, the canonical Google selected, whether it could fetch the page, and when it last tried. Use "Test live URL" as well, because the stored result may predate your fix.

Step 2 — Confirm the page is reachable at all

Is it returning 200? Is it disallowed in robots.txt? Does it carry a noindex? These three account for most cases where a page has never been indexed at all, and all three are visible in URL Inspection.

Step 3 — Check the canonical Google chose

If Google selected a different canonical than you did, that is the answer. Decide whether the pages really are duplicates. Google is frequently right about this, and forcing a canonical it disagrees with rarely works.

Step 4 — Check internal links to the page

Not sitemap entries — actual links from indexed pages. An orphaned page is the most common cause of "Crawled — currently not indexed" and the easiest to fix.

Step 5 — View the page with JavaScript disabled

If the content vanishes, Google may be indexing an empty page. "Page indexed without content" is the explicit version of this; a thin-looking page in Google's assessment is the quiet version.

Step 6 — Ask whether the page deserves indexing

The uncomfortable step, and often the correct one. If the page is one of forty near-identical variants, or exists only to target a keyword variation, Google declining to store it is the system working as designed. The fix is fewer, better pages — not more indexing requests.


What does not help

Requesting indexing repeatedly. It does not change the assessment, and Google states resubmission is unnecessary for the two "currently not indexed" statuses.

Submitting a sitemap again. Sitemaps aid discovery. They do not cause indexing, and a page Google has already seen and declined is not affected.

Third-party indexing services. They generally work by generating links and pings. If Google declined to store the page on quality grounds, none of that addresses the reason.

Adding schema markup. It helps machines understand a page. It does not persuade Google to index one it decided against.


Frequently asked questions

What does "Crawled — currently not indexed" mean?
Google fetched the page and chose not to store it. Google's own guidance says it may or may not be indexed later and that no action is required. In practice the usual causes are thin or near-duplicate content, a new site with little signal, or a page nothing internally links to.

How do I fix "Crawled — currently not indexed"?
Not by resubmitting — Google says that is unnecessary. Check first whether the page has internal links from indexed pages, because orphaned pages are the most common and most fixable cause. Otherwise the answer is making the page materially more useful than the alternatives Google already has.

What does "Discovered — currently not indexed" mean?
Google knows the URL exists but has not crawled it yet and has rescheduled. On a small site this is usually temporary. Across thousands of URLs it usually means URL bloat — parameters, filters and archives competing for crawl attention — or a server too slow under crawl load.

Can a page blocked by robots.txt still be indexed?
Yes. Google states it always respects robots.txt but that this does not prevent indexing if other sites link to the page. It can appear in results without a description, because Google was never allowed to read it. Use noindex instead if you need a page kept out.

Why did Google choose a different canonical than the one I set?
Because it judged another URL a better representative, usually because the pages are near-duplicates. A canonical is a hint rather than a directive. Check whether the pages genuinely differ in substance; if they do not, Google's choice is usually the correct one.

Does requesting indexing in Search Console help?
For a genuinely new or recently fixed page, it prompts a crawl. For a page marked "Crawled — currently not indexed", it does not change the assessment, and Google says resubmission is unnecessary. Repeated requests do nothing.

How long should indexing take?
There is no guaranteed timeframe. A well-linked page on an established site is often indexed within days; a new site can take considerably longer. If a page has been "Discovered" for weeks, the constraint is usually crawl attention rather than the page itself.

Is a large "not indexed" number a problem?
Not on its own. Most of that total is normally made up of statuses that are working as intended — alternate pages with canonicals, redirects, 404s, and pages you marked noindex. The reasons are the data; the total is not.


What to do next

Run URL Inspection on the page you are worried about, and use "Test live URL" rather than trusting the stored result.

If it comes back "Crawled — currently not indexed", check internal links before anything else. That single check resolves more of these than every other fix combined.


Related guides

Free: The 60-Minute Email Authentication Fix

A no-fluff checklist to set up SPF, DKIM & DMARC correctly and pass Gmail & Yahoo's sender requirements.

Muhammad Basim

About the Author

Muhammad Basim

Digital Marketer & WordPress Developer

Muhammad Basim has worked in digital marketing since 2013, focused on email deliverability and AI-assisted content production. He is the author of The Email Deliverability Playbook and The Email Copywriting Playbook.

Related Articles

Newsletter

Free: The 60-Minute
Email Authentication Fix

A no-fluff checklist from the Deliverability Playbook. In one hour: set up SPF, DKIM & DMARC correctly, check your domain against blocklists, and pass Gmail & Yahoo's 2026 sender requirements.

No spam — that would be ironic. Unsubscribe anytime.