[Zope] robots.txt

Paz paz@chello.nl
Fri, 1 Jun 2001 08:34:11 +0200


Hi,

Of course we all know about robots.txt, but I must say I havent created one
in my zopeshop, yet, I see that crawlers are coming in and checking them
out, with the 200 status. I don't have one in apache either which is my
front-end, so where is it coming from? Does zope create on automatically?
Will one that I create myself (DTML Document) in the root of zope be picked
up?


Thanks,
Paz