1 Jun
2001
1 Jun
'01
6:34 a.m.
Hi, Of course we all know about robots.txt, but I must say I havent created one in my zopeshop, yet, I see that crawlers are coming in and checking them out, with the 200 status. I don't have one in apache either which is my front-end, so where is it coming from? Does zope create on automatically? Will one that I create myself (DTML Document) in the root of zope be picked up? Thanks, Paz
9074
Age (days ago)
9074
Last active (days ago)
0 comments
1 participants
participants (1)
-
Paz