[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: How to scrape?

To: <syndication@yahoogroups.com>
Subject: Re: How to scrape?
From: Aaron Swartz <aswartz@swartzfam.com>
Date: Tue, 20 Mar 2001 19:48:38 -0600
In-reply-to: <LPBBLCJIHOIDJNIFKFBPKEDOCKAA.alis@purplepages.ie>
User-agent: Microsoft-Entourage/9.0.2509

Alis Marsden <alis@purplepages.ie> wrote:

> I'm guessing I'd do it by spidering the pages somehow but there really
> doesn't seem to be much information about how it could be done on the web.

The way I do it is that I load the text of the page in to memory, than use
regular expressions to extract the proper information. Then I just spit it
out in RSS.

If you'd like some Tcl code to do this, I can send you some.

-- 
[ Aaron Swartz | me@aaronsw.com | http://www.aaronsw.com ]

Follow-Ups:
- [syndication] Re: How to scrape?
  - From: Morbus Iff <morbus@disobey.com>
- Re: How to scrape?
  - From: "David Smiley" <dsmiley@mitre.org>

References:
- How to scrape?
  - From: "Alis Marsden" <alis@purplepages.ie>

Prev by Date: Re: [syndication] some republished feeds
Next by Date: [syndication] Re: How to scrape?
Previous by thread: RE: [syndication] How to scrape?
Next by thread: [syndication] Re: How to scrape?
Index(es):
- Date
- Thread