Crawlable but invisible: indexed vs cited

Updated 2026-07-05

A page can be perfectly crawlable, fully indexed by Google, and still be practically invisible in AI generated answers. Crawlable, indexed, and cited are three separate states. A lot of otherwise solid content quietly stalls out between the second and the third. This guide covers that gap.

Crawlable means a bot can reach it

Crawlable is the simplest condition: the page returns a normal response, robots.txt does not block it, and a working path leads in from the rest of the site's internal link graph. Every other guide in this resource hub is really about making sure this first condition holds. Orphan pages and click depth are two examples.

Indexed means a system has stored it as a candidate

Indexed goes a step further: a search engine or AI system has actually processed the page and added it to whatever internal store it uses to answer future queries. Google Search Console can tell you whether Google has indexed a page. Most AI systems offer no equivalent public tool. No direct way often exists to confirm a page has been indexed anywhere beyond Google's own index.

Cited means it actually appeared in an answer

Cited is the state that actually matters commercially. A real person asked a real question. The AI system's answer named or linked your page as a source. A page can be crawlable and indexed and still never get cited. The system may have judged another page a better match for the specific questions people were asking. The page's content may instead not have clearly answered a question in the way the system's retrieval step rewarded.

Why the gap exists

Retrieval systems behind AI answers typically favour content that answers a specific question clearly and directly. Clean structure and unambiguous claims beat content that is technically crawlable but vague, thin, or buried behind unnecessary preamble. A page can pass every crawlability and structure check sitemap.digital runs and still lose out to a competitor's page that simply answers the underlying question more directly.

What is coming: a GSC overlay

A future feature is planned that overlays real Google Search Console data (impressions, clicks, and indexing status) on top of a scan's crawlability and AI readiness results. It will let you see where a page is crawlable and scoring well but still not getting real query traffic. That feature is not live yet. This guide will be updated once it ships. The goal is to make the gap between crawlable and cited measurable rather than theoretical.

Frequently asked questions