RE: [Zope] Zope & search engine indexing...
-----Original Message----- From: addyd@unk.edu [mailto:addyd@unk.edu] Sent: Tuesday, February 01, 2000 12:47 PM To: zope@zope.org Subject: [Zope] Zope & search engine indexing...
Is there any problem with Zope generated pages being indexed by search engines?
Nope.
I'm assuming that since a bot simply requests an URL (and "normal" URLs are one of Zope's strengths) that the bot will index the full page source assembled from the Zope object pieces by the server (the same source that would normally be rendered by the browser). Is this correct, or am I missing something?
Yeah, the problem is if the spider tries to follow links including their query string (everything after the ?). This can cause the server to generate pages that may depend on each other and cause infinite loops, each request having a different URL to the spider. All the crawlers that I've ever heard of disregard anything after the '?'. -Michel
Darren Addy University of Nebraska at Kearney
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
At 13:29 Uhr -0500 01.02.2000, Michel Pelletier wrote:
Is there any problem with Zope generated pages being indexed by search engines?
Nope.
You should name the pages that are to be spidered ending in .html or .htm just to be on the save side. Some spiders are known trying to avoid any dynamic pages and therefor ignore pages that get parameters passed to them (anything after "?") or are not named according to the above sheme.
[...] All the crawlers that I've ever heard of disregard anything after the '?'.
Mhmm, I'd rather say they won't follow those links at all... Jochen
participants (2)
-
Jochen Haeberle -
Michel Pelletier