Re: [syndication] Re: RSS feed filtered by keywords?

[Rick Bradley <roundeye@roundeye.net>]

* Bill Kearney (ml_yahoo@ideaspace.net) [030204 10:16]:
> > But that assumes that it is practical to store all items flowing in
> > many-many feeds in a database.  What happens when instead of  200,000
> > feeds we are dealing with 200,000,000 feeds or even 200,000,000,000
> > feeds.  If the AOLs and the MSNs get the knack of RSS , then we got to
> > think of how this is going to scale way way beyond where we are today.
> 
> That's, frankly, bullshit.  That;s just another rendition of the old "it'll
> never scale" argument.  Please.  So nothing should be tried in the interim?
> Right now the run rate of feeds isn't approaching anywhere near the numbers
> you're suggesting.  Yes, it's certainly possible that more people will start
> sites.  Most won't stick to it so it's not like it'd matter.  As for resources
> available, in the days of 200gb drives and 3gHz processors that hardly has any
> bearing whatsoever.

FWIW (in agreement), unless something fundamentally changes in the
interim, when we have to deal with scaling to 200M or 200G feeds the
bottleneck will not be storage or processor power, it will be bandwidth.
As long as our storage and processing capacity in this realm continues
to far exceed that needed to deal with the data coming down our pipes
arguments against scalability are mostly noise.

Rick
-- 
 http://www.rickbradley.com    MUPRN: 286
                       |  future) services.
   random email haiku  |  Or simply help coordinate
                       |  other services.