justuptime.com - monitor your servers & websites

Robots.txt query

You are viewing this site as a guest. Join our community to get your questions answered and share knowledge. Active members may advertise and ask for a website critique.

They have: 16 posts

Joined: Nov 2006

Hi,

Does the robots.txt

User-agent: *
Disallow:
Disallow: /login.asp

also dissallow URLs like

domain.com/login.asp?register=Y
and
domain.com/login.asp?someotherstring

and so on?

They have: 38 posts

Joined: Sep 2006

google has a great tutorial on this