XML Sitemap
An XML sitemap is a file listing the URLs a site wants search engines to know about, together with metadata such as last-modified time.
Why it matters
A sitemap is the set of URLs a site declares about itself, which makes it a far cheaper unit of truth than crawling every link — you monitor what the site says it has, not wherever a crawler happens to wander.
