Skip to content

INDEXING

Indexing —
a document absent from search
is absent from the answer

Indexing is the precondition for all search and answer visibility. We tidy the sitemap and robots.txt, register with the search consoles to put documents into the candidate pool, then confirm per engine whether they were actually indexed and record it.

In one paragraph

Indexing is the stage where a search engine collects a page and registers it in its own database. A document that is not indexed is not a candidate in search results, nor in the AI answers that draw on that index. We bundle sitemap, robots.txt, console registration and change notification into one procedure, and confirm per engine whether the submitted addresses were actually indexed.

Submission does not guarantee indexing. Collection cycles and judgement criteria differ per search engine, and within the same site some pages get picked up while others are left. So our scope ends at confirmation rather than at submission — a report with a submission history and no index result tells you nothing.

Sitemap · robots.txtGoogle · Bing · Naver consolesIndexNow notificationIndex status confirmed

Last verified

WHEN YOU NEED THIS

When you have these problems,
this is the work you need

These are the situations we hear repeatedly in consultations. If any of them apply, start by measuring.

We published a new article and search has not picked it up for weeks

Not yet indexed, and indexed but mismatched to the query, are different causes with different responses. Without confirming index status first there is no way to decide whether to fix the content or the technology.

We submitted the sitemap and do not know what got indexed

Submission is a request that announces candidates, not a result. Consoles have a separate screen for index results and for live URL diagnosis, and mixing the two makes a normal state read as an error.

We have many pages and far fewer indexed

Duplicate documents, thin auto-generated pages, and settings that name a redirecting address as the canonical are the common causes. Before making more pages, the reason the existing ones dropped out has to be separated.

We resubmit every URL on every deploy

Repeatedly submitting addresses whose content has not changed is a spam signal. Registering one sitemap address in the console is enough — the search engine re-reads it on its own, so there is no need to resubmit whenever it changes.

WHAT WE DO

What Navirang
actually does

Written as units of work rather than abstract proposals. The scope of an engagement is set from this list.

Tidying the sitemap

The sitemap gets refined into a candidate list. What matters is not having many URLs but that every address in the list returns 200 and matches the canonical URL format.

  • Excluding admin screens, internal search results and parameter duplicates from the list
  • Comparing the published document list against the sitemap list to find missing addresses
  • The lastmod rule itself belongs to technical SEO; here we only check the value does not disagree with the submitted list
  • Declaring the sitemap address in robots.txt so crawlers find it themselves

Managing crawl budget with robots.txt

Paths not worth collecting are cleared so crawlers spend their time on the body. We use robots.txt on the premise that it signals collection priority rather than controlling access.

  • Clearing paths that are not indexing targets, such as admin and internal search results
  • Cross-checking that robots.txt does not block addresses listed in the sitemap — the state where submission and blocking contradict each other gets removed first
  • Separating the roles of blocking (robots.txt) and index exclusion (a noindex meta tag) — a blocked address cannot be read, so its noindex is never seen
  • Where privacy is the goal, applying access control separately

Search console registration

The site gets registered and the sitemap submitted with Google, Bing and Naver. Ownership verification differs per engine, so ordering it reduces the work.

  • Google Search Console — a domain property verified with one DNS TXT record covers www and http variants in a single property
  • Bing Webmaster Tools — importing from Search Console skips ownership verification entirely
  • Naver Search Advisor — an HTML meta tag, registered with the full address including protocol
  • Sitemap and RSS submission across all three, plus the initial index request

Change notification (IndexNow)

Changes get notified only after a deploy that actually changed content. Repeatedly submitting unchanged URLs is a spam signal, so submissions are limited to changed addresses.

  • Submitting only the URLs whose content changed in this deploy
  • Notifying the Naver Search Advisor endpoint and the IndexNow hub together
  • Google does not participate in IndexNow, so a separate request goes through Search Console URL inspection
  • Recording submission targets and response codes per deploy, and keeping them

Confirming index status

We confirm per engine whether submitted addresses were actually indexed, and record it. Repeating submissions without confirming leaves you never knowing what worked.

  • Checking result counts per engine with the site: operator (verifying the operator itself works first, against a control domain)
  • Distinguishing the console's live URL inspection from its collection history — before collection, 'no data' is the correct output
  • Distinguishing sitelinks, which are a display format attached to one document, from an index count
  • Recording indexed and visible-in-search separately

Separating the causes of non-indexing

Pages missing from the index get split by cause. Different causes call for different responses, and for some the right answer is to exclude them from indexing.

  • Classifying URLs pushed out as duplicate or near-duplicate — consolidating the documents themselves is handed to content SEO
  • Splitting thin pages into reinforce and exclude-from-indexing
  • Correcting settings that name a redirecting address as the canonical
  • URLs whose collection came back empty get classified as a rendering cause and handed to technical SEO

PROCESS

In what order
does it run

What you receive at each stage is stated alongside it. Durations are the working time Navirang controls; they are not a promise about when results appear.

  1. 01 2–3 days

    Index baseline

    We write down, as it is, which engine confirms each individual URL and the state of the sitemap list, robots.txt and console registration. The before state has to exist for later change to be comparable.

    Per-URL index record

  2. 02 3–5 days

    Sitemap and robots work

    We correct the sitemap's lastmod and scope, and clear the paths in robots.txt that are not indexing targets.

    Tidied sitemap · robots.txt

  3. 03 1–2 days

    Console registration

    The site is registered with all three consoles and sitemaps submitted. Ownership verification needs an account login, so it is a stretch the client clicks through themselves — we prepare the tag and DNS values and the procedure.

    Console registration record

  4. 04 On deploy

    Change notification

    Only changed URLs go to IndexNow, with Google requested separately via URL inspection. On a no-change deploy nothing is sent.

    Submission log

  5. 05 Periodically after deploy

    Index re-check

    We reconfirm indexing per engine and classify the remaining unindexed URLs by cause. Collection cycles differ per engine, so one check does not finish it.

    Index re-check record

DELIVERABLES

What you
receive

We do not do work that ends in conversation. The documents below remain, and become the baseline for the next measurement.

Per-URL index record

Not a page-count total but which engine confirmed each individual URL. The before state is recorded with it so later change compares on the same basis.

Sitemap and robots checklist

Sitemap scope, lastmod and response codes, and robots.txt rules, marked pass or fail item by item.

Console registration record

Registration state across all three, the ownership verification method used, and the sitemap and index request history. A document written so nobody has to find it again when the owner changes.

Change notification log

Per deploy, which URLs were submitted where and what the response was. It is also the evidence that no unchanged submission was made.

Non-indexing cause list

Unindexed URLs split into duplicate, thin, canonical-to-redirect and rendering-dependent, with the ones where exclusion is the right answer marked as such.

The indexing configuration we applied to our own site

Ownership verification
Google via a domain property (DNS TXT), Naver via an HTML meta tag — all three including Bing completed on 2026-07-30
Sitemap submission
Sitemap and RSS submitted once to Naver Search Advisor and never resubmitted when content changes. The sitemap address is also declared in robots.txt
Excluded paths
The admin screen is handled separately by sitemap filter, robots.txt Disallow, a noindex meta tag and access control
Change notification
The Naver Search Advisor endpoint plus the IndexNow hub. Only URLs whose content changed
Notifying Google
Google does not participate in IndexNow — requested separately via Search Console URL inspection
Submission record
37 URLs on the 2026-08-13 deploy — Naver 200 OK 37/37, IndexNow hub 200 OK 37/37. Every page's content genuinely changed in that deploy, so the full set was exactly 'only what changed'
First indexing
Site launched 2026-07-29 → Naver indexing confirmed 2026-08-03 (home, 1 result). One other new domain took 9–13 days

The first-indexing record has a sample of two, so we do not explain the elapsed days as causal. There is no reason not to do work that costs almost nothing, but claiming the effect is verified would need a larger sample.

HOW IT CONNECTS

How it connects
to the other work

Our work moves as one piece. SEO builds the foundation for being found by search engines, AEO raises the odds of that information being cited in an answer, structured data helps machines understand the facts, and content supplies the evidence there is to cite.

Area Relationship to this work
Technical SEO The technical conditions before indexing — rendering, URL format, site structure
Content SEO Removing duplicate and thin documents at the document design stage
AI crawler optimization Handling answer engine crawler access policy separately
AEO audit Checking index status alongside answer engine citation measurement
Structured data Stating the facts of an indexed document in a machine-readable form

FAQ

Frequently asked questions

Q Does submitting a sitemap get us indexed?

A Submitting does not produce indexing. A sitemap is a candidate list announcing that these addresses exist; whether to collect them and whether to put them in the index is the search engine's judgement. That said, without submitting you wait until a crawler happens to find them through an internal or external link, so it is more accurate to read submission as bringing the moment of discovery forward.

Q Do we have to resubmit to the console when the sitemap changes?

A No. What was registered in the console is one address — the sitemap file — and the search engine re-reads that address periodically. Declaring the sitemap address in robots.txt also lets crawlers find it themselves. Individual requests via IndexNow or console URL inspection are only added when a new URL needs announcing quickly.

Q How long does indexing take?

A It differs per engine and per site. Our own site launched on 29 July 2026 and Naver indexing was confirmed on 3 August; another new domain we recorded the same way took 9 to 13 days. With a sample of two we do not promise a number of days, and new domains commonly take weeks. While waiting there are two things to check — whether the submission was actually accepted, and whether any setting still blocks indexing.

Q Does sending every URL to IndexNow on each deploy speed up indexing?

A We do not recommend it. Repeatedly submitting addresses whose content has not changed is a spam signal, and we submit only URLs whose content actually changed. Submitting everything only equals 'only what changed' on a deploy where every page genuinely changed. And Google does not participate in IndexNow, so IndexNow alone sends Google no signal at all.

Q We are indexed but do not appear in search results. What should we look at?

A Indexing and visibility are different stages, so the diagnosis has to separate them. Indexing only means the document entered the database; appearing for a particular query requires being judged the document for that query. A case we actually met on another site had indexing perfectly fine while the phrasing users actually typed appeared nowhere on the page. What needed fixing there was the wording and composition of the document, not an indexing setting.

Q Can we block pages we do not want indexed with robots.txt?

A If the goal is index exclusion, use a noindex meta tag. Blocking with robots.txt means the crawler cannot read the page and therefore cannot read the noindex inside it, and cases arise where the address stays in the index on external links alone. We apply sitemap exclusion, a robots.txt Disallow, a noindex meta tag and access control together to our own admin screen — because saving crawl budget, excluding from the index and genuinely blocking access have to be handled by different means.

Q Does each of Google, Bing and Naver need its own ownership verification?

A The methods differ enough that ordering it collapses part of the work. Registering Google as a domain property verifies with one DNS TXT record and covers www and http variants in a single property. For Bing, importing from Google Search Console skips ownership verification entirely. Naver uses an HTML meta tag on the page, which needs one deploy. So we recommend finishing Google first.

You submitted the sitemap — have you checked which URLs are actually indexed?

Send us a URL and the free audit reports the confirmed index result per URL rather than the submission state. Missing URLs are split by cause: duplicate, thin, redirect or rendering.

We reply within one business day.

Free audit Call Email Blog