https://www.webmaster-forums.net/crss/node/1037927 en https://www.webmaster-forums.net/html-css-and-javascript/robots-exclusion-question#comment-1216991 <p>You're welcome.</p> <p>And yes, if you don't want the "id" pages indexed either, blocking the whole page is the way to go.</p> <p><img src="https://www.webmaster-forums.net/misc/smileys/smile.png" title="Smiling" alt="Smiling" class="smiley-content" /></p> Tue, 27 Mar 2007 15:30:54 +0000 jGirlyGirl comment 1216991 at https://www.webmaster-forums.net https://www.webmaster-forums.net/html-css-and-javascript/robots-exclusion-question#comment-1216972 <p>Thanks for this. I do not want any URLs with the id parameter indexed anyway so perhaps excluding /availability.asp would be the way forward?</p> Tue, 27 Mar 2007 09:31:56 +0000 Hampstead comment 1216972 at https://www.webmaster-forums.net https://www.webmaster-forums.net/html-css-and-javascript/robots-exclusion-question#comment-1216953 <p>Hi Hampstead, </p> <p>You can actually single out certain parameters for the Googlebot. Adding these lines to your to your robots.txt file tells the Googlebot not to index any URL's with "theyear" and "themonth" parameters:<br /> <div class="codeblock"><code>User-agent: Googlebot<br />Disallow: /*theyear=<br />Disallow: /*themonth=</code></div>'</p> <p>If you were to exclude /availability.asp in your robots.txt file, it <em>would </em>also exclude the URL's with the "id" parameter.</p> <p>More info on the Googlebot wildcard here: <a href="http://www.seobook.com/archives/001329.shtml" class="bb-url">Google Robots.txt Wildcard</a></p> <p><img src="https://www.webmaster-forums.net/misc/smileys/smile.png" title="Smiling" alt="Smiling" class="smiley-content" /></p> Mon, 26 Mar 2007 17:17:25 +0000 jGirlyGirl comment 1216953 at https://www.webmaster-forums.net