fetch robots / get xml sitemap
Paste text(1 url per line)
Paste XML (strip xml and convert to urls)
10mb limit
Upload file
Fetch stream
HTMX
Sitemap data
Find sitemap files
robots
Upload file!
old
tst
filter
search
static
Find sitemap file:
http://localhost:4000/sitemapfile?url=toertocht.be
Get urls from sitemap
http://localhost:3000/sitemap?xmlsitemap=https://www.essent.nl/sitemap.xml
http://localhost:3000/sitemap?xmlsitemap=https://voltasolar.nl/sitemap_index.xml
http://localhost:3000/sitemap?xmlsitemap=https://www.nederlandisoleert.nl/sitemap.xml
http://localhost:3000/sitemap?xmlsitemap=https://tom-i.nl/sitemap.xml
http://localhost:3000/sitemap?xmlsitemap=https://www.snelste.nl/sitemap.xml
http://localhost:3000/sitemap?xmlsitemap=https://www.jumbo.com/dam/jumbo/sitemaps-non-aem/sitemap_product_detailpages.xml
http://localhost:3000/sitemap?xmlsitemap=https://www.ing.nl/sitemap-cms.xml
http://localhost:3000/sitemap?xmlsitemap=https://www.snelste.nl/sitemap.xml
http://localhost:3000/sitemap?xmlsitemap=https://www.ah.nl/sitemaps/entities/allerhande/recipes.xml
robotstxt
http://localhost:3000/robots?url=https://www.amazon.nl
http://localhost:3000/get-json-details