Re: [syndication] robots.txt and rss

["James Linden" <jlinden@lindensys.net>]

> > The only way a robots.txt file is going to have any relevance here is
> > that the robots.txt file could indicate that a particular user-agent
> > should NOT load from within a given part of the hierarchy.  This would
> > be equivalent to not having the feed available.
>
> maybe i want to block out specific software users or types of users, and
> allow individuals to keep doing what they're doing.

    The only things you will succeed in blocking are going to mainstream
applications. It won't even make anyone who is really intent on getting the
RSS even stutter.  Kinda pointless to block based on user agent, or even IP
(altho it is a bit better).

James