I'm starting to see lots of hits on my sites from friendly, neighborhood search engines. Lots more than I'd expect. Looking closely, I noticed that I've got tunnelling URL syndrome. The requests look like: /ab/wa/ab/wa/ab/wa/ab/wa/index_html I fear that this may go on forever! My sites are sitting behind apache with URL rewriting turned on, and my REQUEST paths include the /ab/wa prefix. I've seen that others have had this problem, but I haven't seen anyone with a solution. I'd prefer not to have to turn all of my links into absolute URLs. Here's another possiblity that I've considered: I could do a browser sniff and if it's a spider and has a more than one /ab/ in the path, I could insert a meta tag in the HTML head: <META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">, as per http://www.robotstxt.org/wc/exclusion.html#meta. Of course, this would require the spider to respect the meta tag. Has anyone figured out any other solutions to this apparent bug in the Virtual Host Monster? Thanks all! Howard Hansen http://howard.editthispage.com
Howard Hansen wrote:
My sites are sitting behind apache with URL rewriting turned on, and my REQUEST paths include the /ab/wa prefix. I've seen that others have had this problem, but I haven't seen anyone with a solution. I'd prefer not to have to turn all of my links into absolute URLs.
Why? <a href="&dtml.url-something;">Go here</a> ...works for me :-) cheers, Chris
participants (2)
-
Chris Withers -
Howard Hansen