> > 2. The train left the station on this with robots.txt. The world > > survived. And robots.txt did not scale, so now we have robots.txt, and the robots meta tag for HTML content, and the Robots HTTP header for other content ... -- Klaus Johannes Rusch KlausRusch@atmedia.net http://www.atmedia.net/KlausRusch/