Tools / XML Sitemap Generator: Crawl Any Site to sitemap.xml
XML Sitemap Generator: Crawl Any Site to sitemap.xml
Crawl a website and generate a ready-to-submit XML sitemap. Input: startUrl. Output (JSON/CSV): one row per item with url, depth, priority, lastmod.
What it's for
- Create a sitemap for a site whose CMS lacks one
- Compare crawlable pages with the existing sitemap
- Submit a fresh sitemap to Google Search Console after a redesign
Example input
{
"startUrl": "https://therealtour360.com",
"maxPages": 60,
"maxDepth": 3
}Example output
{
"url": "https://therealtour360.com/",
"depth": 0,
"lastmod": null,
"priority": 1
}Input reference
| Field | Type | Notes |
|---|---|---|
startUrl required | string | Homepage or section to crawl. |
maxPages | integer | Max pages |
maxDepth | integer | Max click depth |
respectRobots | boolean | Respect robots.txt |
excludePatterns | array | e.g. /tag/, \?page= |
includeLastmod | boolean | From article:modified_time / og:updated_time. |
maxConcurrency | integer | Max concurrency |
Pricing
Pay per event: Page crawled and included $0.0005. Plus Apify's small per-run start fee. Apify's free plan includes monthly credit to try it.
How to run
- Open the Store page and click Try for free.
- Fill in the input (or paste the example JSON in the JSON tab).
- Click Start, then export results as CSV, Excel or JSON, or call it via the Apify API.
- Optional: add a Schedule and a webhook/Slack/email integration for ongoing monitoring.