Duplicate Pages

cliffhanger posted this at 15:44 — 25th September 2007.

Joined: Aug 2007

Hello,

I generate pages dynamically for most parts on my mammoth size website. Now, I suddenly discovered that I have ended up generating a whole lot of duplicate pages. How do I get rid of all these? I mean from the search engine indexes... I know about the no index no follow tag, and the 301 redirects. But I am unsure about what to do... can somebody suggest? Adding redirects to all the pages would be a real pain for me...

Thanks

Sam

pr0gr4mm3r posted this at 17:23 — 25th September 2007.

He has: 1,502 posts

Joined: Sep 2006

Could you give us some examples of your duplicate content?

cliffhanger posted this at 08:43 — 26th September 2007.

They have: 33 posts

Joined: Aug 2007

Here goes...

domain.com/bla-bla/index.htm
domain.com/Bla-bla/index.htm

ya, i didnt know they were case sensitive... the URLs...

Sam

cliffhanger posted this at 17:12 — 26th September 2007.

They have: 33 posts

Joined: Aug 2007

Hello,

I see a lot of results on google when I do a site: operator search. This should not be, I do not have so many pages on my website. Now, I have submitted my sitemap recently. Can multiple sitemap submission cause this problem? Do I have to contact Google about this? Thank you.

Sam...

kaykays posted this at 11:51 — 10th October 2007.

He has: 17 posts

Joined: Oct 2007

To remove your pages from Google, I suggest you register your web-site with Google Webmaster Tools. It has an option Remove URLs to help you remove urls.

The quote below is taken from that page:

Quote: To remove content from the Google index, do one of the following:

* Ensure requests for the page return an HTTP status code of either 404 or 410.
* Block the page using a robots.txt file.
* Block the page using a meta noindex tag.

Your content will then be removed from the index the next time Google crawls your site. If you need to expedite your content removal, make sure you have met one of the requirements listed above, and then select the New Removal Request button below to use this automated tool.

Hope it helps.

tummy posted this at 13:23 — 22nd October 2007.

They have: 121 posts

Joined: Mar 2007

Thanks for nice tips.