Re: [syndication] Contacting Aggregators

[burtonator <burton@relativity.yi.org>]

"james@xmlTree.com" wrote:
> 
> Steven
> 
> > I think our forums have been picked up by some aggregators as I have seen
> > our XML Exports grow greatly as of late. We are used to maybe a couple
> > thousand a day but that has grown to over 200,000 a day this week.
> 
> If the XML is generated dynamically, this starts to amount to significant overhead.  I
> have the same problem with some of my OCS files of available RSS channels.  Some
> aggregators are insensitive and set up bots which collect RSS content every half hour,
> without checking the HTTP expiry header or the <updateFrequency> element in the
> corresponding OCS document.

I have to admit that Jetspeed isn't too polite in this regard.  Of
course it is OSS and you can fix it if you want :)

I don't know how many installations of Jetspeed are out there and
running.  The default interval for fetching is 3600 seconds.

Kevin
-- 
Kevin A Burton (e-mail: burton@apache.org, UIN: 73488596, ZKey:
burtonator)
http://relativity.yi.org
Message to SUN:  "Please Open Source Java!"
To fight and conquer in all your battles is not supreme excellence;
supreme 
excellence consists in breaking the enemy's resistance without fighting.
    - Sun Tzu, 300 B.C.