[Zope] ZCatalog and Xron

Luton, Alex ALuton@rcseng.ac.uk
Thu, 30 Jan 2003 10:09:35 -0000


I'm in the process of trying to build a reliable, accurate search engine
using a ZCatalog. In order to keep the catalog contents up to date, I
added an Xron method to reindex the catalog every hour. This worked fine
on a small site, but for a site with a catalog of 1300 documents the
data.fs file grows from a few hundred meg to several gig before long,
and apache/zope dies. Another problem is that Xron seems to trigger its
methods as many times as it 'missed' if the server is stopped for a
while.
I'm only indexing dtml documents, and the ZCatalog doesn't use any
metadata or special indexes.
Are there any ways to prevent the catalog updates being stored in the
ZODB, so no undo history is saved for the ZCatalog? 

Thanks

--
Alex
This e-mail and any attached files are confidential and are intended
solely for the use of the individual or entity to whom they are
addressed.

This communication represents the originators personal views and
opinions, which do not necessarily reflect those of The Royal College of
Surgeons of England.

If you are not the intended recipient, or the person responsible for
delivering the e-mail to the intended recipient, be advised that you
have received this e-mail in error, and that any use, dissemination,
forwarding, printing or copying of this e-mail is strictly prohibited.

http://www.rcseng.ac.uk

Registered Charity Number: 212808