https://www.webmaster-forums.net/crss/node/1036481 en https://www.webmaster-forums.net/serverside-scripting/need-help-scripting-web-crawler#comment-1210183 <p>I can't really help you as I've never tried it myself, however it will help those that can if you give us more detail. What scripting language/databases are you planning to use? PHP? ASP.NET? etc etc... What server platform are you on? Windows / Linux? Which webserver are you using? IIS? Apache? Zeus?</p> Wed, 08 Nov 2006 13:56:20 +0000 andy206uk comment 1210183 at https://www.webmaster-forums.net