About XML Sitemap Generator

An XML sitemap is a file that lists the pages you want search engines to crawl and index. It follows the open sitemaps.org protocol, and Google, Bing and other engines read it to discover new or updated pages faster, which matters most for new sites, large sites, and pages that are buried several clicks from the homepage. This generator builds the file for you by crawling your website the way a search engine would: it starts at the address you enter, reads robots.txt, follows internal links breadth-first, and records every indexable page it reaches, up to the page and depth limits you choose.

Unlike simple link collectors, the crawler makes the same decisions a careful SEO would. Pages marked noindex are left out, pages whose canonical tag points to a different URL are replaced by that canonical address, redirects are followed to their destination instead of being listed, broken pages and non-HTML files such as images and PDFs are skipped, and URLs blocked in robots.txt are ignored when that option is on. Last-modified dates are taken from the server's own headers rather than guessed, and priority is assigned by click depth so your homepage and key sections rank above deeper pages. You can optionally add a change frequency or include URLs with query strings.

When the crawl finishes you can review the generated XML, filter the list of included URLs, see exactly what was excluded and why, and download a ready-to-upload sitemap.xml. A single sitemap file may hold up to 50,000 URLs, far above this tool's limit of 500 pages, so very large sites should generate a sitemap per section or use their CMS's built-in sitemap feature. Only publicly reachable pages can be crawled, and pages that depend entirely on JavaScript to show their links may not be fully discovered.