https://www.webmaster-forums.net/crss/node/1016414 en https://www.webmaster-forums.net/serverside-scripting/perl-site-map-maker#comment-1095218 <p>Well. I'd probably want to have some control in the script to say things like "just display the html or htm pages" and "if there's a meta tag with robots saying 'noindex,nofollow' etc, then don't index me". But yes, listing everything in each directory would not be good!</p> Sat, 01 Dec 2001 23:17:47 +0000 rline comment 1095218 at https://www.webmaster-forums.net https://www.webmaster-forums.net/serverside-scripting/perl-site-map-maker#comment-1095145 <p>I've used something like this, but it gives the entire contents of the whole folder and its subfolders... I really dont want all those out there...<br /> You want it to display everything in the folder or only a certain type of file?</p> Fri, 30 Nov 2001 21:52:01 +0000 nike_guy_man comment 1095145 at https://www.webmaster-forums.net