My ne site Search webby has been indexed by Google but despite the fact that I went to great lengths to ensure that every page got spidered, the google bot only crawled a very small part of the site:
http://www.google.co.uk/search?q=inurl:www.searchwebby.com&hl=en&lr=&filter=0
Why did it do this and how do I get the rest crawled?






teammatt3 posted this at 00:38 — 17th November 2004.
He has: 1,907 posts
Joined: Sep 2003
You have to wait a while, (I think) it took google about 5 months to index my entire site.
mullet posted this at 23:12 — 1st December 2004.
He has: 31 posts
Joined: Jan 2004
i managed to get on google in about 2 months by using the Web ceo software. and ive just noticed that today my site had 459 hits from Web Crawler - Googlebot/2.1 which is abit strange as i only get 50 or so a day, give it time and google will do a deep crawl soonish.
you do need patients in this game
http://www.totalsmudge.co.uk
http://www.13outlaws.net
TaylorAtCTS posted this at 05:12 — 2nd December 2004.
He has: 153 posts
Joined: Nov 2004
google indexed my site 3 days after i got submitted, but it has not finished. I am in the top slots on my keywords though
Memphis Web Design - Memphis Website Design - Memphis Website Development
CTS designs the best looking, most functional customized marketing solutions from web design to brochures with a 100% satisfaction guarantee, all for a price that fits your budget.
beitemiller posted this at 20:37 — 2nd December 2004.
They have: 15 posts
Joined: Nov 2004
I have found one good way around this problem. I have started a blog (a few months back) that seems to get spidered rather frequently (many backlinks, new posts almost daily, etc.)
I then put links from my blog to deep within the website that I want cached by Google.
Usually take me about 7-10 days at the most to get a website deepcrawled. Of course, this will not work with a rather large site. Do you have a sitemap on your index page? That would help as well...
Arizona SEO Services
Prescott Real Estate - AZ
webads101 posted this at 08:39 — 24th December 2004.
They have: 61 posts
Joined: Dec 2004
I read from somewhere else: "If your site content is updated often, Googlebot will come to read your site often." I believe it is true from my website's log.
Hot-Web-Ads.com: 100% FREE Online Advertising. No Sign up Required to Post.
Hot-Web-Ads.net: Add Your Link for FREE
MattBarron posted this at 20:08 — 2nd January 2005.
He has: 2 posts
Joined: Jan 2005
I am having real trouble getting my website mbarronconsulting.com to appear on Google at all despite submiting my index page to Google about 3 months ago. I have a good selection of relevant keywords listed in my tags, and my title tag is relevant. I also have a sitemap available from the index page. Despite this, my site doesn't even seem to be notices by Google - could it be that it hasnt indexed it yet, or am I missing a keypoint somewhere.
Hope you can help.
Matt
------------------------------------------
Matt Barron
Director & Principal Consultant
MBarron Consulting Ltd - Human Factors services
email: webmaster@mbarronconsulting.com