RE: [syndication] site-wide metadata discovery

["Chad Everett" <yahoogroups@jayseae.cxliv.org>]

Hi Dave -

Thanks for the vote of confidence.  :)

Here's where I found that text:

http://www.robotstxt.org/wc/norobots.html

Under "The Format", at the end of the sentence just prior to "User-agent".

It actually says "Unrecognised headers are ignored".  I took some small,
hopefully irrelevant, liberties with my interpretation.  :)

Chad.

-----Original Message-----
From: Dave Winer [mailto:dave@userland.com] 
Sent: Wednesday, October 15, 2003 5:44 PM
To: syndication@yahoogroups.com
Subject: Re: [syndication] site-wide metadata discovery


This is a very interesting idea.

I just went for a quick look and couldn't find where it says "unrecognized
headers should be ignored."

And then we'd have to know if it works in practice too, just because a spec
says robots should work some way doesn't mean they do.

But kudos for coming up with a new angle. Worth exploring, imho.

Dave