[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

RSS scrapers I've been working on...



Joe Cliburn <djeaux@djeaux.com> wrote:

Dunno if I'm re-inventing the wheel, because it was easier to write the scripts than search the web for one.

#1 scrapes the latest posts from 2 Google Groups (rec.music.dylan & rec.music.folk). Pretty much any newsgroup could be configured VERY easily, but I don't have that kind of server space & bandwidth!

You can see an the newsgroup scraper in action at:
http://dylanfreak.djeaux.com

#2 scrapes listings from specific eBay for any category. I've set up four at http://dylanfreak.djeaux.com/classified.shtml

Dunno if either of them is "legal", but I'm planning to use the eBay with my affiliate ID kludged into the links ;-)

Like I said, I dunno if these reinvented the wheel & I'm pretty sure there ain't a CPAN Perl module for parsing an eBay listing!

The RSS's are at:
http://www.djeaux.com/rss/

In both cases, the Perl scripts can be very easily modified to do pretty much any query of either of those sites. I'm willing to give the scripts (source) to anybody who (a) promises to use them & (b) promises not to make snide comments about my coding style :-)

Oh, whatever... I enjoyed your website. Informative.


Joe
--
djeaux e-tech consulting
http://www.djeaux.com

MiniScore for Women's Gymnastics
http://miniscore.djeaux.com


--
Julian Bond Email&MSM: julian.bond@voidstar.com
Webmaster:              http://www.ecademy.com/
Personal WebLog:       http://www.voidstar.com/
CV/Resume:          http://www.voidstar.com/cv/
M: +44 (0)77 5907 2173   T: +44 (0)192 0412 433