https://www.webmaster-forums.net/crss/node/1026649 en https://www.webmaster-forums.net/serverside-scripting/problem-botindexing-my-asp-pages#comment-1160245 <p>MSNbot is a rude bot, very unbehaved and will take more than just the kitchen sink if you don't watch them. I personally blocked msnbot several months ago for several reasons, 1/ it has nothing to do with msn search site, 2/ doesn't only take .html,.php files etc it takes .zip, .txt, .avb, .bgb, .tar as well as images etc 3/ is a bad bandwidth hog</p> <p>Slurp is usually pretty well behaved but gets confused sometimes I think. It's not uncommon for it to look for outdated files. keep an eye on it, it could be looking for something.</p> Sat, 09 Oct 2004 23:18:52 +0000 Busy comment 1160245 at https://www.webmaster-forums.net