That would be a good

Greg K — Wed, 24 Mar 2010 01:14:00 +0000

That would be a good recommendation if the site being scraped was intending for people to grab the content and use it elsewhere.

Based on the content on both sites, looks to me, like one site wants to just rip the content from one to put on their own competing site.

While I could provide a way to get what is being looked for, based on the the outwardly look for the use, I won't unless it can be clarified the purpose and the permissions since both sites list they are copyrighted, and I choose not to go near any infringement issues.

-Greg

Have you thought of using XML

hhunt — Tue, 23 Mar 2010 23:50:52 +0000

Have you thought of using XML instead? It is one of the easiest ways to consume data rather that scrapping the screen. The script you have there requires us to run first to determine what the problem is...and some of us don't have that time.

My advice is to look for XML or RSS feed for the site(s) in question and use one of the many libraries out there to parse it.
Good luck.