What we check
For every same-origin page linked from the scanned page (capped at a fixed number), fetches it and checks whether it's indexable: a 200 response with no noindex signal (neither a <meta name="robots"> nor an X-Robots-Tag noindex/none) means it must appear in the sitemap. Passes if every such page is listed. Fails and names the missing page(s) otherwise. If the sitemap is an index, the first 10 entries the index lists are considered, and only same-site ones among them are read; a page missing while some child sitemap was not read is inconclusive, not a fail. Also inconclusive when there's no sitemap at all, no same-origin links were found, or none of the linked pages could be verified.
Why it matters
A sitemap that leaves out real, indexable pages gives an agent an incomplete map of your site: it can list what's there but can't know what's missing.
More checks in Agent actionability
Can an agent find its way around the site?
- Exactly one H1 on the page
- Reasonable heading hierarchy
- sitemap.xml exists
- sitemap.xml is parseable
- Internal navigation links present
- Canonical URL is same-origin
- Structured navigation present
- An agent can tell what the site is for
- Key actions are described in plain language
- Content is structured so an agent can extract facts
HelpAEO