[Zope] Non compliant robots

[J. Atwood]

> What do people do when their sites get traversed by a robot that keeps
> generating Zope errors ( cookies not enabled I guess ) that doesn't
> observe the robots.txt conventions?  ( I get the errors emailed me which
> is annoying :-(  )

Hey Graham, 

I have exactly the same problem (robot hits my site, I get 400 emails of
errors even with a robots.txt file). I am not sure what the answer is except
to add something to your error page that would filter out robot errors.

J