[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [syndication] site-wide metadata discovery



> Bill Kearney <wkearney@syndic8.com> wrote:
> >Site-Index:    http://somesite.example.com/feedindex.xml
> >http://purl.org/ocs/directory/0.5/
>
> I woke up thinking "put the pointer in robots.txt" and discovered
> someone had beaten me to it. Damn!

Once upon a time I heard this concept attributed to comedy.  Often it seems like
the same joke instantaneously comes to life in many different places all at
once.  Tech stuff's often the same way.

> Interestingly, robots.txt is valid if trivial YAML[1]. So I wonder what
> would happen if you added lines like
>
> Site-Index: default
>   href: http://somesite.example.com/feedindex.xml
>   type: http://purl.org/ocs/directory/0.5/
>   title: My Feed List
>
> I suspect that existing readers of robots.txt would treat this as one
> long line with continuation.

I've got an example setup at:
http://www.syndic8.com/robots-test.txt

I'm open to feedback on it.

-Bill Kearney
Syndic8.com