[Zope] TIP: Robots.txt

BZ bz@bwanazulia.com
Sat, 9 Nov 2002 07:59:03 -0500


I have many websites running off of one Zope installation and so it was 
not too bright to put a robots.txt fill in the Zope root and let all 
the sites inherit it down. Today, though, I wanted to customize one of 
them so I did this.

# Robots file for <dtml-var absolute_url>
User-agent: *
Disallow: /Manage
Disallow: /acl_users
Disallow: /images
<dtml-if robot_local>
<dtml-var robot_local>
</dtml-if>

Again, nothing hugely brilliant, but I thought it was interesting 
enough to publish.

I will put it up on Zope.org.

Cheers,
BZ