[Zope] TIP: Robots.txt
BZ
bz@bwanazulia.com
Sat, 9 Nov 2002 07:59:03 -0500
I have many websites running off of one Zope installation and so it was
not too bright to put a robots.txt fill in the Zope root and let all
the sites inherit it down. Today, though, I wanted to customize one of
them so I did this.
# Robots file for <dtml-var absolute_url>
User-agent: *
Disallow: /Manage
Disallow: /acl_users
Disallow: /images
<dtml-if robot_local>
<dtml-var robot_local>
</dtml-if>
Again, nothing hugely brilliant, but I thought it was interesting
enough to publish.
I will put it up on Zope.org.
Cheers,
BZ