XML Sitemap Generator

It starts at the URL you enter and follows links to other pages on the same host, level by level, four pages at a time. It skips links to images, PDFs and other files, removes #fragments, obeys the robots.txt rules for all crawlers, and leaves out pages marked noindex or whose canonical tag points to another URL.

Up to 1,000 pages per crawl, with 200 as the default. You can stop the crawl at any time and still download a sitemap of the pages found so far. For larger sites, paste your URL list instead; that mode handles any number of URLs and splits the output into 50,000-URL files with a sitemap index.

The crawler reads the HTML your server sends and doesn't run JavaScript, so links that only appear after scripts run won't be found. Pages that no other page links to, pages blocked by robots.txt, noindex pages and pages with a canonical tag pointing elsewhere are also left out. The skipped list shows each reason.

lastmod is the only one Google uses, and only when it is accurate. Setting every page to today's date is fine for a first sitemap, but long term your CMS should write the real last-changed date. Google ignores changefreq and priority, though some other search engines may read them.

Upload sitemap.xml to the root of your site so it loads at https://yourdomain.com/sitemap.xml. Then add a line such as Sitemap: https://yourdomain.com/sitemap.xml to robots.txt and submit the URL in Google Search Console and Bing Webmaster Tools.

Yes, with no sign-up. Pages are fetched through Hypello's server only because browsers can't read other sites directly. Nothing is stored.