moshdj2uk — Sun, 04 Feb 2007 00:06:08 +0000

@benf: If using PHP, look into posting server headers, fopen() and regular expressions. It's far too complicated for me to give a tuorial on it here, but if you learn about those, you'll be more than half way there.

Sorry for digging this thread up again. Thank you all for the input. I've taken your advice and changed the site. Flaffle has now became a meta-search engine. I'd like feedback on the new direction.

Thanks.

benf — Fri, 12 Jan 2007 12:43:01 +0000

Hi, i like it. Good idea. Means that with the little extra effort you also know that the websites are serious about being searched, perhaps not just for link popularity. How did you create the bot...ive been looking to create one and know one seems to know?

moshdj2uk — Sun, 17 Dec 2006 03:28:48 +0000

If you'd had read the thread, you'd have figured out why.

MoeAlza — Sun, 17 Dec 2006 03:14:37 +0000

It looks great but I searched anime and did not get any results. Nice logo too.

moshdj2uk — Sat, 16 Dec 2006 17:14:21 +0000

Well the bot would then have to crawl all your pages on your site. At present, I don't have the server resources to have the bot do that for each and every site being indexed. The main reason for linking every page in, is for the bot to keep track of proken links easier. In essence, the bot has little to do to check for broken links in the sites. If a page is linking in, it exists on the refering server and is active. Simple.

It will take time to build up the database which is my main issue just now. I'm hoping that after some interest, the ball should get rolling and the links will keep coming in at an increasing rate. However, that will take time.

@pisstaker
You still don't have a meta description added. No worries though, you have over 2 weeks to get it sorted until the next index.

waffles — Sat, 16 Dec 2006 16:54:17 +0000

In order to get the databas built up, you might need to just go in and either let some people add a site or add some yourself.

Why do I need to link to Flaffle from every page of my blog if I want it all indexed? Isn't one link enough?

pisstaker — Sat, 16 Dec 2006 15:33:06 +0000

moshdj2uk;212212 wrote: Thanks, much appreciated. However, at the moment, the description for the results are fed from the meta-description tag of the refering pages and as such, must be valid for the pages to be indexed by the bot. From what I can see, none of your pages on your blog have a meta-description tag.

I've been keeping up with your blog ever since you created the entry about Flaffle. I'm hooked.

Thanks for pointing that out. I didnt pay much attention to completing meta data tags at the start of the blog building process so I added keywords at a later date. I thought that was sorted but as a result of your comment I just found out my blog software apparently doesnt update metadata tags on existing pages sitewide, so I was living in ignorant bliss. However it was easy enough to add data via a different input box, so i hope your flaffle engine picks it up.

Glad to hear you are hooked. We are revamping the site at the moment, so maybe we will be hooking even more folks. It is good fun, but hard work at the moment. We will hopefully attract some input from other writers to lighten the load.

moshdj2uk — Sat, 16 Dec 2006 13:23:45 +0000

Thanks, much appreciated. However, at the moment, the description for the results are fed from the meta-description tag of the refering pages and as such, must be valid for the pages to be indexed by the bot. From what I can see, none of your pages on your blog have a meta-description tag.

I've been keeping up with your blog ever since you created the entry about Flaffle. I'm hooked.

pisstaker — Sat, 16 Dec 2006 04:50:09 +0000

I just linked to you so we shall see what happens. Good luck taking on Google.

moshdj2uk — Wed, 13 Dec 2006 22:42:17 +0000

It will take time to get the database built up. I've yet to start advertising it. I'm hoping that after I start advertising it, word will catch on. Time will tell.