Sitemap Validator for SEO & AI Crawlers

An XML sitemap is a file that lists all the important URLs on your website, helping search engines discover and crawl your pages more efficiently. Without a sitemap, crawlers rely entirely on following links — which means orphan pages, deep pages, or newly published content may never get indexed. For AI crawlers like GPTBot, a sitemap is often the primary discovery mechanism.

Google's Rich Results Test validates syntax. We go deeper: we analyze crawl budget waste (what % of your sitemap is wasted on redirects, 404s, and duplicates), check which AI crawlers are blocked by your robots.txt, detect the common CMS bug where all lastmod dates are identical, analyze URL consistency (HTTP vs HTTPS, www vs non-www, trailing slashes), and give you a prioritized action plan instead of a flat error list.

Crawl budget is how many pages search engines will crawl on your site in a given time period. Every redirect, broken URL, and duplicate in your sitemap wastes a crawl request that could have been used to discover or re-crawl important content. Sites with tight crawl budgets (large sites, new sites, sites with low authority) are most affected.

AI answer engines like ChatGPT, Perplexity, and Google's Gemini crawl the web using bots like GPTBot, PerplexityBot, and Google-Extended. If your robots.txt blocks these bots, your content cannot be indexed for AI-generated answers. With AI search growing rapidly, blocking these crawlers means missing a significant and growing discovery channel.

Many CMS platforms and sitemap plugins set every URL's lastmod to the same date (often today's date or the date the sitemap was generated). This makes lastmod useless — crawlers use lastmod to prioritize which pages to re-crawl first, and if every page has the same date, no page gets priority. Our tool detects this automatically.

A single sitemap file can contain up to 50,000 URLs and must be no larger than 50MB uncompressed. For larger sites, you need a sitemap index file that references multiple child sitemaps. Our tool supports sitemap indexes and analyzes up to 5 child sitemaps in the free version.

Coverage measures how well your sitemap represents your site's content. It factors in URL count, section diversity (are all areas of your site represented?), whether you use a sitemap index for scalability, and lastmod coverage. A low coverage score means important pages may not be in your sitemap.

Yes. Your sitemap should only contain the final destination URLs — the pages that return a 200 status. Including redirects (301, 302) wastes crawl budget because the crawler has to follow the redirect chain, and the redirecting URL provides no value. Update your sitemap to point directly to the canonical destination.

Check your robots.txt for rules like 'User-agent: GPTBot / Disallow: /' — these block the entire site from that crawler. To allow access, either remove the Disallow rule or change it to 'Allow: /'. You can also selectively block certain paths while allowing others. Our tool shows exactly which crawlers are blocked and the specific rules causing it.

URL consistency issues include mixed HTTP/HTTPS, mixed www/non-www, and inconsistent trailing slashes. These create duplicate content signals — search engines may index both versions, splitting link equity. Your sitemap should use one consistent URL format throughout, matching your canonical URLs.

No. Google has confirmed it 'still doesn't use' either <changefreq> or <priority>. These tags add XML bloat without SEO benefit. Google only uses <loc> (required) and <lastmod> (when consistently accurate). Our tool detects these ignored tags and recommends removing them to keep your sitemap lean.

Sitemap extensions let you provide metadata for specific content types: image sitemaps (image:image, image:loc), video sitemaps (video:video with required thumbnail, title, description, and content URL), news sitemaps (news:news with 2-day freshness rule and 1,000-entry limit), and hreflang annotations for multilingual sites. Our tool detects all four extension types and validates their required tags.

IndexNow is a push-based protocol that lets you instantly notify Bing, Yandex, and other supporting search engines when URLs are added, updated, or deleted. It's complementary to sitemaps — sitemaps are the stable baseline, IndexNow is for real-time change notification. Our tool checks if your site has an IndexNow key configured.

Yes. Unless submitted via Google Search Console, a sitemap generally only affects URLs that are descendants of the directory where it's hosted. A sitemap at /blog/sitemap.xml only covers URLs under /blog/. Google recommends placing sitemaps at the site root to avoid accidental scoping issues. Our tool detects when your sitemap is in a subdirectory and URLs fall outside its scope.