Google has only listed some of my web pages - in fact only the main page and two smaller ones. Is this normal? Will it come back again and finish the rest. In my robots text I instructed Google to come back after 8 days - will it do this or come back sooner / later?
Regards
~S
chrishirst posted this at 18:48 — 16th May 2005.
He has: 379 posts
Joined: Apr 2005
First, you can't tell the SE bots to do anything other than go away or not index. The meta revisit-after tag tells any robot that obeys the tag (and none actually do) to NOT to come back for 8 days. bots will visit on their own schedule.
It will take time to crawl all pages on your site, how long depends on how important Google "thinks" your site is
Chris
Indifference will be the downfall of mankind, but who cares?
Venue Capacity Monitoring
Code Samples
5meodmt posted this at 11:16 — 2nd June 2005.
He has: 36 posts
Joined: Jun 2005
to get all your pages index...try settting up a sitemap that deeplinks to all your pages the google spider should index your pages better
**ecomatrix.eu - FREE Eco friendly Web Hosting**
Web Hosting|Shoutcast Hosting|Broadband
shashankhi posted this at 04:19 — 10th June 2005.
They have: 4 posts
Joined: Jun 2005
I agree with 5meodmt. Google seldom gives importance to pages beyond the third level. i.e. the pages accessible only after 2 clicks from the home page. So be certain to include a sitemap which condenses the entire site.
Another thing, Google bot is a busy bee. It indexes zillions of sites out there. It's got a prefixed schedule according to which it gets through some sites first and then only does it come to you. Generally, for a small site, like your and mine, google visits back in about a month. So, for me, I've stopped worrying about it. Simply go on with developing and maintaining the site.
----------------------------------------------------------
Pick14.com - Win MTV T Shirts. Simply subscribe to Pick14 and then refer it to 5 people.