RE: [syndication] Re: RSS vs. HTML Bandwidth and "Scalability"...

["Jeff Barr" <jeff@vertexdev.com>]

Before I head off on vacation, there are two interesting ways 
to address scalability that seem very relevant here:

1. The notification model that Dave mentioned earlier. It is not
   clear to me how this works through firewalls and/or NAT.

2. A push-based model. The Knownow toolkit could be used to do
   this (disclaimer -- I have done consulting work for them and
   could be considered biased).  Downloads are available at
   http://developer.knownow.com

I would be interested in doing the client-side work to support 
either or both of these if someone wants to do some server-side
experimentation sometime in the Fall.

Jeff;

-----Original Message-----
From: Matt Jensen [mailto:mattj@newsblip.com] 
Sent: Friday, August 03, 2001 7:37 AM
To: syndication@yahoogroups.com
Subject: [syndication] Re: RSS vs. HTML Bandwidth and "Scalability"...


>>   c) Implement server control - block repetitive ip's
>>      on a cron'd schedule and allow them back in when
>>      the going gets happy.

>I don't want to have to micromanage my servers. I don't want to have 
>bars on my windows. I want to build a community where people don't 
>abuse my resources as a matter of course but are free to them when it 
>isn't a drain on me.

For NewsBlip, I've implemented server-based control.  Before that, I'd
see a number of people getting NewsBlip's Top Headlines RSS file
repeatedly, every ten seconds, which added up to gigabytes. So in my
experience, hoping nobody abuses your RSS resources is like hoping
nobody sends you a virus.

Each request is checked against a database of IP addresses,  and the
client is sent an error message if they've made another request in the
last five minutes.  I have a few tricks that keep this check speedy.

(By the way, this is my first post to this list. I've been lurking for a
little while.  I think collaboration within this community is a great
idea.)


-Matt Jensen
 NewsBlip.com
 Seattle



 

Your use of Yahoo! Groups is subject to
http://docs.yahoo.com/info/terms/