# The sitemap.pl script is built upon our expertise and also upon our experience with Google Sitemaps.
# Quickly and easily add Google Sitemaps to your websites.
# Benefits & Features :
1.uses mod_rewrite.
2.Generates Google Sitemap .xml and .txt files.
3.Runs on your server and scans directories for files (in your website only); faster file discovery than a spider since it does not use http.
4.Install once and forget about it. Now you can update your website and be sure that your sitemaps will always reflect what your website contains.
5.Uses mod_rewrite to associate sitemap.xml and sitemap.txt requests to the sitemap.pl script located in cgi-bin.
6.Caches the .xml and .txt files so if requested, does not have to rescan for files. Stale time of 1 hour.
7.The cached .xml / .txt files can be manually copied to the root directory so the script never runs again in case you just want a sitemap snapshot.
8.Can specify files and directories to be skipped; can specify as: full URL, URL with * wildcard, or filename extension (e.g.: .gif, .jpg, .asp, ...). Common "skips" already configured (and can be unskipped). and automatically calculated.
9.Supports up to 50,000 URL's, and 10MB files.
10.Fast directory scanning. About 500 to 750 URL's found per second.
Note: Intended for use with real files that are physically located on your server. Does not recognize virtual files generated via .htaccess (mod_rewrite) such as WordPress webpages.