[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: News Aggregator Software



> Scraping from web pages is an adventure.  It will break should the 
site in
> question do anything to change what your scraper depends upon.  In 
general it's
> considered better all around to encourage the source to create 
their own RSS
> feed.  They're not hard to make, most content/portal tools support 
it.  Or can
> be made to do so easily.

All true, except that I took his situation to be that he already had 
a feed but wanted the *articles* in plain-text. Surely nobody is 
going to provide the entire body of the article in the feed. 

Maybe Josh can clarify...?