[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
RE: [syndication] Headline Viewers
My suggestion is to create a list (M - multiple) of domains that has
multiple feeds.
Then go down your list (F - feeds) of feeds and if it is on the (M) list,
move the feed to list (W - wait) with a time code of now() plus 6 seconds.
You can rapid fire the (F) list (even spawn multiple threads to get several
at the same time) and have a thread that gets the feeds in the (W) list, but
paying attention to the earliest time (set above) when it can be done.
There are other ways, but this is one...
Thanks for considering it!!
Sincerely,
Steven Roussey
Network54.com
http://network54.com/?pp=e
> -----Original Message-----
> From: Gleb Dolgich [mailto:glebd@kaunas.omnitel.net]
> Sent: Friday, August 25, 2000 12:39 AM
> Subject: Re: [syndication] Headline Viewers
>
>
> Hello,
>
> Novobot (http://www.proggle.com/novobot) gets XML feeds sequentially, but
> may do it several times for one provider in succession. I would be glad to
> hear your suggestions on how to make it more provider-friendly.
>
> Thanks.
> Gleb Dolgich (glebd@proggle.com)
> http://www.proggle.com
> The Web is News with Novobot!
>
> ----- Original Message -----
> From: "Steven Roussey" <sroussey@network54.com>
> To: <syndication@egroups.com>
> Sent: Friday, August 25, 2000 00:38
> Subject: [syndication] Headline Viewers
>
>
> > Hi all!
> <...>
> > Soooo, there must be headline viewers out there that go and get all the
> > feeds in rapid succession, even if they are from the same site (in which
> > case they are ignoring the common robot protocol for spacing out
> requests).
> <...>
> > Does anyone have a list of Headline Viewers? The one that
> really hurts is
> > Java based and is likely European or at least not English based. The IPs
> are
> > generally in Europe and some in South America.
> <...>
> > Sincerely,
> >
> > Steven Roussey
> > Network54.com
> > http://network54.com/?pp=e
> >
>
>
>
>
>