
Search engines need to "crawl" or "index" your site to take a snapshot of the pages that appear in the search engine.
Some search engines (most prominently Google) can use a "sitemap" file to decide how to crawl the site in a more intelligent manner (for example, by crawling frequently changed pages more often). The site www.sitemaps.org has more details about sitemap files.
We're often asked how to create a sitemap file. There are a couple of common ways to do it:
The Web site at http://www.xml-sitemaps.com/ will generate a sitemap file for you if you enter just a few details about your site. This is the easiest way to create the file.
For technically advanced users, Google offers a sitemap generator script that you can use. If you're comfortable using the command-line shell and running scripts on the server, this method is more flexible. However, it's not recommended if you don't have experience using the shell.
For full details, please see the Sitemap Generator page on the Google Web site. That page lists six things you'll need to know; here's a summary of that information:
pythonOnce you know these details, you should be able to follow the instructions on the Google Sitemaps page. It lists several different methods; we recommend using the "access log" method.