Sitemap Tag

In your robots.txt file on a line by itself, add the following command to tell the search engines your Sitemap location: Sitemap: <sitemap_location> The <sitemap_location> should be the complete URL to your Sitemap according to sitemaps.org. Below is 4WebResults.com’s robots.txt file with the Sitemap Tag. User-agent: * Sitemap: http://4webresults.com/sitemap.xml Disallow: /createMember Disallow: /portal_memberdata/portal_factory/ Disallow: /*sendto_form$ Disallow: /*folder_contents$ Disallow: [...]