admanage - performance enhanced search technology

Where can I get a list of every single website on the net

You are viewing this site as a guest. Join our community to get your questions answered and share knowledge. Active members may advertise and ask for a website critique.

They have: 3 posts

Joined: Mar 2008

Hi there,

I am a relatively newbie Webmaster and am doing some research on the scale of the internet and websites. I am trying to find a source or reference guide which will give me a list of every website out there.

According to Netcrafts latest February figures there are 158,209,426 active websites out there and I just wondered where I could get the actual list of names.

Any help would be much appreciated.

regards

AB

They have: 100 posts

Joined: Feb 2008

To be honest. I do not think this is actually possible. I think that list would prove useless anyway.

You would be better off looking for sites that were relevant to your own and you can get this by choosing key words and using google.

Can I ask, what would you use such a list for?

They have: 3 posts

Joined: Mar 2008

Hi caffinephil,

thank you for your response. I was really hoping there would be some resource of sorts as this would have made my life a lit easier, however now it seems I will have to compile one, which adds more time to a project we are working on, which is why I require the list. Unfortuntely I would be unable to go into further detail.

However I should you come across anything that has all the information that would be great. I just find it odd, that something as huge and powerful as the internet does not have a "simple list of all its members".

Sites like google are fantastic as they help disect teh different websites, into smaller "parcels", but sometimes you just need the "entire baggage".

Thank you for your response once again.

kind regards

AB

Greg K's picture
Moderator

He has: 1,597 posts

Joined: Nov 2003

Well, what exactly would you consider a website?

I have about 10 domains, only 3 with really used sites, but they each have a site.

then there is one domain there it nothing there on the main domain, but there are many domain.com/whatever where whatever is a topic, each one a different "site"....

-Greg

[This space intentionally left blank]

Cool Geek Supplies: www.ThinkGeek.com

They have: 3 posts

Joined: Mar 2008

Hi Greg,

Thank you for your response. Essentially I am more interested in how many "websites" are out there. If you go to the Netcraft website (I don't know if we are permitted to put links in these forums so I won't, but if you Google them) you will read in the February 08 Web Server Survey, that they received "responses from 158,209,426 sites" which apparently is an increase of 2.6 million sites. It is those 158,209,426 sites we are interested in getting the list of. I realise a lot of "Resellers" will purchase domain names for "parking purposes" which is fine because at the end of the day it is still a "website" in my opinion.

I have been looking into "Ping" programs this afternoon to see if we can get some sort of list that way as I presume that is what Netcraft had to do in order to get a response. I could be totatly wrong and any corrections would be appreciated.

Kind regards

AB

JeevesBond's picture
Moderator

He has: 3,465 posts

Joined: Jun 2002

I haven't got much to add to what others have mentioned here, for arguments sake those Netcraft figures are alright. One thing about those figures is that they include MySpace profiles, but not Facebook ones. Again it comes down to what you count as a Website.

Aside from being skewed in Microsoft's favour the Netcraft figures are probably about as good as it gets. Smiling Just for future reference: you can post any links that aren't spam. You don't have to worry though, we're not strict, nor will we shout at you if you make a mistake. Smiling

a Padded Cell our articles site!