How to Fix Pages Not Getting Indexed in Google Search Console

First, Decode What Each Verdict Actually Means

Search Console's indexing states form a funnel, and knowing where a page sits in it tells you which fixes even apply. "URL is unknown to Google" means Google has never discovered the URL at all — it is not a quality judgement, it is absence of discovery. "Discovered – currently not indexed" means Google knows the URL (usually from your sitemap) but has not spent crawl budget on it yet. "Crawled – currently not indexed" means Google fetched the page and decided not to index it yet — this is where quality and duplication start to matter. "Duplicate without user-selected canonical" and "Alternate page with proper canonical tag" mean Google found more than one copy of the content and is choosing between them.

A brand-new domain almost always sits in the first two states for weeks. That alone is not a problem. What IS a problem is anything that makes Google's job harder while it decides how much to crawl you — and duplication is the most common self-inflicted wound.

Step 1 — Rule Out Hard Blockers In Five Minutes

Before anything clever, eliminate the three ways a site tells Google to go away. Check robots.txt (yourdomain.com/robots.txt) actually allows crawling — a stray "Disallow: /" from a staging config is more common than anyone admits. View source on a few pages and confirm there is no <meta name="robots" content="noindex">. Then check response headers for X-Robots-Tag: noindex — this one hides in CDN and hosting configs where you would never look, and it never shows up in your HTML.

# check the header nobody remembers to check
curl -sI https://yourdomain.com/some-page/ | grep -i x-robots-tag

# check what robots.txt actually serves
curl -s https://yourdomain.com/robots.txt

Step 2 — Hunt Down Duplicate Versions Of Your Site

Google hates ambiguity about which URL is "the real one", and most sites unknowingly serve their entire content at two or more addresses. The two we find constantly: the www/non-www split, and hosting-platform preview domains.

Test the www variant: if https://www.yourdomain.com returns your site with a 200 status instead of redirecting, every page on your site exists twice. Canonical tags mitigate this, but a 301 redirect from one host to the other removes the ambiguity entirely and consolidates crawl. Then test your hosting subdomain — yourproject.pages.dev, yourapp.vercel.app, yoursite.netlify.app. If those serve your content indexable, Google may crawl and even prefer them. They should either redirect to your real domain or send an X-Robots-Tag: noindex header.

• curl -sI https://www.yourdomain.com/ — expect a 301 to the bare domain (or the reverse); a 200 means duplicate site
• Check your host's default subdomain (.pages.dev / .vercel.app / .netlify.app) — noindex it or redirect it
• Confirm every page's canonical tag points at the one true URL, trailing slash included
• If you moved from http, confirm http:// 301s to https:// on every path, not just the homepage

Step 3 — Make Your Sitemap Earn Its Keep

Submit the sitemap in Search Console (Sitemaps → enter the URL) and then actually read the report: last downloaded date, discovered URL count, and errors. If you have deployed many times since the "last downloaded" date, resubmit — it prompts Google to fetch the current file rather than waiting for its own schedule. Make sure the URLs inside the sitemap are the canonical form (same host, same trailing-slash convention as your canonical tags) — a sitemap full of URLs that redirect wastes the little crawl budget a new site gets.

Step 4 — Give Google Reasons And Routes To Crawl

Discovery follows links. Orphan pages — reachable only through the sitemap — sit in "Discovered – currently not indexed" the longest. Strengthen internal linking so every important page is reachable within two or three clicks of the homepage: related-content blocks, category hubs, footer links for cornerstone pages. Then use URL Inspection → "Request indexing" on your handful of most important pages. It is rate-limited and not magic, but for key pages it reliably pulls the crawl forward.

Finally, be honest about demand signals. A young domain with no external links gets a small crawl allowance. One or two legitimate mentions — a business directory, an industry association, a local chamber, a supplier's partner page — measurably accelerate how seriously Google takes a new site.

What NOT To Do

• Do not resubmit the same URLs for indexing every day — the quota is small and repeat requests do nothing
• Do not delete and resubmit your Search Console property — you lose history and fix nothing
• Do not add third-party "instant indexing" tools or ping services — the Indexing API is for job postings and live events, not regular pages
• Do not panic-rewrite all your content in week two — "Discovered, not indexed" on a new site is a queue, not a rejection

The Fix, Step By Step

1. 1

   Run URL Inspection on 3–5 key pages

   In Search Console, inspect your homepage plus a few important inner pages. Write down each verdict — the rest of the fix depends on whether pages are unknown, discovered, crawled-not-indexed, or duplicates.

2. 2

   Check robots.txt, meta robots, and the X-Robots-Tag header

   Confirm robots.txt allows crawling, pages have no noindex meta tag, and — the one everyone misses — no X-Robots-Tag: noindex response header from your CDN or host (curl -sI yourpage | grep -i x-robots).

3. 3

   Kill duplicate hosts: www and platform subdomains

   301-redirect www to the bare domain (or the reverse — pick one). Noindex or redirect your host's default subdomain (.pages.dev, .vercel.app, .netlify.app). Confirm canonicals all point at the surviving host.

4. 4

   Resubmit the sitemap and verify its contents

   Resubmit in Search Console after fixing duplicates so Google re-downloads the current file. Every URL in it must be the canonical form — no redirects, no old host, consistent trailing slashes.

5. 5

   Request indexing on priority pages and strengthen internal links

   Use "Request indexing" for your top pages, then make sure no important page is an orphan — link it from the homepage, hubs, or related posts.

6. 6

   Give it 2–6 weeks and re-inspect

   On a young domain, indexing follows trust, and trust follows time plus signals. Re-run URL Inspection weekly; verdicts moving from "unknown" to "discovered" to "crawled" means the machine is working.

Frequently Asked Questions