[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [syndication] Can anyone guess the aggregator?
Julian Bond wrote:
> About once an hour I get hit by a request for
>
> /index.rss
> /b2rdf.php
> /b2rss.xml
> /b2rss.php
> /rss.xml
> /index.rdf
> /index.xml
That's either Mark Pilgrim's rssfinder.py [1] or something following the
same autodiscovery algo: look for the autodiscovery link element [2], if you
don't find it, start looking for well-known RSS filenames. Once an hour from
the same IP? That sounds like it might be a scraper, looking a little too
hard to see if you've suddenly added an RSS feed that it can switch to.
Phil Ringnalda
[1] http://diveintomark.org/projects/rss_finder/
[2]
http://diveintomark.org/archives/2002/06/02/important_change_to_the_link_tag
.html