OAI-SearchBot has to be able to read the page
If robots.txt blocks this crawler, the page drops out of the candidate pool for search-backed answers regardless of content quality. It is the first item we check in an AEO audit.
CHATGPT
OpenAI gives its training, search, and user-request crawlers different names. Which of the three you allow or block decides whether you can appear in a ChatGPT answer at all.
SHORT ANSWER
ChatGPT is an answer engine operated by OpenAI. The first gate on whether you get cited is crawler access, and OpenAI splits its crawlers into three by purpose — GPTBot collects training data, OAI-SearchBot builds the search index, and ChatGPT-User fetches a page on the spot when a user asks for it. If appearing in search-backed answers is the goal, the decisive one is OAI-SearchBot.
SPEC
Only items that can be verified are listed. Rows with a verification method on the right can be reproduced yourself.
CONDITIONS
These are the items that differ most in this engine. Principles common to every engine are collected on the answer engines hub.
If robots.txt blocks this crawler, the page drops out of the candidate pool for search-backed answers regardless of content quality. It is the first item we check in an AEO audit.
Body text painted in by JavaScript can look like an empty page to a crawler. What a human sees and what a crawler reads have to be verified separately.
Answer engines do not use a document whole; they cut pieces out of it. A cut paragraph has to still make sense on its own to work as a citable unit.
A claim that exists only on your own page is weaker evidence than a fact that is confirmed repeatedly across different sources.
MYTHS
Only the ones we meet repeatedly in audits.
“Allowing GPTBot is enough to show up in ChatGPT search”
GPTBot is for training. The route into search-backed answers is the index built by OAI-SearchBot. Confusing the two and opening only the training crawler is a genuinely common configuration.
“Publishing more articles raises the odds of being cited”
Several documents answering the same question compete with each other for the same slot. What has to grow is not the number of documents but the number of distinct questions they answer.
“If you show up in ChatGPT you will show up in Google”
The indexes are different. Google ranking and ChatGPT citation run through separate pipelines, and it is common for one to move while the other stays flat.
HOW TO CHECK
A Navirang audit follows the same order. There is nothing stopping you from running it internally first.
Open yourdomain.com/robots.txt in a browser and check the rules that apply to OAI-SearchBot, GPTBot and ChatGPT-User.
In a logged-out session, ask a question your brand should be the answer to, and record brand mentions in the answer text and your own domain in the source list **separately**.
Repeat the same question with different phrasings. Never judge from a single response.
Check your server log for OAI-SearchBot visits and the timestamp of the most recent one.
FAQ
Each answer is written to be quoted as it stands.
We can build the conditions for it; we cannot guarantee it. OpenAI itself states in its official documentation that there is no way to guarantee top placement. Three things are actually within reach — open the site so OAI-SearchBot can read it, write the documents that should be the answer in citable units, and measure the same questions under the same conditions repeatedly so changes are recorded. If a proposal promises a guarantee, it is worth asking what that promise rests on.
No. GPTBot collects training data, while the route into search-backed answers is the index built by OAI-SearchBot. For a publisher whose content is itself the product, blocking only GPTBot while allowing OAI-SearchBot is a valid choice. The reverse is not: blocking OAI-SearchBot removes you from search-backed answers regardless of training.
Not immediately. The crawler has to come back, read the document, and have it reflected in the index, and the revisit interval differs by site. Submitting a sitemap and using IndexNow can bring the revisit forward. Navirang records a baseline at the start of an engagement and reports what changed and when, with the raw observations attached.
A mention is your brand name appearing in the answer text; a citation is your domain appearing in the source list. Because ChatGPT attaches sources inline, the two can be told apart by eye. They move independently — a state where the name is known but the document is not used as evidence, and a state where the document is cited but the brand is not foregrounded, call for different work.
RELATED
The canonical crawler list is kept as a table in a separate article — this page carries only the rows for this engine.
Last verified August 27, 2026
Send us a URL and our free audit asks the questions in all 7 engines and reports what actually came back, recorded engine by engine.
We reply within one business day.