[Zope] Tunneling URL hell.

[Howard Hansen]

I'm starting to see lots of hits on my sites from friendly, neighborhood
search engines.  Lots more than I'd expect.  Looking closely, I noticed that
I've got tunnelling URL syndrome.  The requests look like:

    /ab/wa/ab/wa/ab/wa/ab/wa/index_html

I fear that this may go on forever!

My sites are sitting behind apache with URL rewriting turned on, and my
REQUEST paths include the /ab/wa prefix.  I've seen that others have had
this problem, but I haven't seen anyone with a solution.  I'd prefer not to
have to turn all of my links into absolute URLs.

Here's another possiblity that I've considered: I could do a browser sniff
and if it's a spider and has a more than one /ab/ in the path, I could
insert a meta tag in the HTML head: <META NAME="ROBOTS" CONTENT="NOINDEX,
NOFOLLOW">, as per http://www.robotstxt.org/wc/exclusion.html#meta.  Of
course, this would require the spider to respect the meta tag.

Has anyone figured out any other solutions to this apparent bug in the
Virtual Host Monster?

Thanks all!

Howard Hansen
http://howard.editthispage.com