[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [syndication] site-wide metadata discovery
Cool. Thanks for the reference.
Now let's set up a test case?
1. My OPML file is here..
http://blogs.law.harvard.edu/myPublicFeeds.opml
2. My robots.txt is here..
http://blogs.law.harvard.edu/robots.txt
3. How would I modify my robots.txt to point to my OPML file?
Dave
----- Original Message -----
From: "Chad Everett" <yahoogroups@jayseae.cxliv.org>
To: <syndication@yahoogroups.com>
Sent: Wednesday, October 15, 2003 5:52 PM
Subject: RE: [syndication] site-wide metadata discovery
> Hi Dave -
>
> Thanks for the vote of confidence. :)
>
> Here's where I found that text:
>
> http://www.robotstxt.org/wc/norobots.html
>
> Under "The Format", at the end of the sentence just prior to "User-agent".
>
> It actually says "Unrecognised headers are ignored". I took some small,
> hopefully irrelevant, liberties with my interpretation. :)
>
> Chad.
>
> -----Original Message-----
> From: Dave Winer [mailto:dave@userland.com]
> Sent: Wednesday, October 15, 2003 5:44 PM
> To: syndication@yahoogroups.com
> Subject: Re: [syndication] site-wide metadata discovery
>
>
> This is a very interesting idea.
>
> I just went for a quick look and couldn't find where it says "unrecognized
> headers should be ignored."
>
> And then we'd have to know if it works in practice too, just because a
spec
> says robots should work some way doesn't mean they do.
>
> But kudos for coming up with a new angle. Worth exploring, imho.
>
> Dave
>
>
>
>
> Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/
>
>