Re: RSS vs. HTML Bandwidth and "Scalability"...

[Matt Jensen <mattj@newsblip.com>]

>>   c) Implement server control - block repetitive ip's
>>      on a cron'd schedule and allow them back in when
>>      the going gets happy.

>I don't want to have to micromanage my servers. I don't want to have
>bars on my windows. I want to build a community where people don't
>abuse my resources as a matter of course but are free to them when it
>isn't a drain on me.

For NewsBlip, I've implemented server-based control.  Before that, I'd see
a number of people getting NewsBlip's Top Headlines RSS file repeatedly,
every ten seconds, which added up to gigabytes. So in my experience,
hoping nobody abuses your RSS resources is like hoping nobody sends you a
virus.

Each request is checked against a database of IP addresses,  and the
client is sent an error message if they've made another request in the
last five minutes.  I have a few tricks that keep this check speedy.

(By the way, this is my first post to this list. I've been lurking for a
little while.  I think collaboration within this community is a great
idea.)


-Matt Jensen
 NewsBlip.com
 Seattle