[Zope] Delayed full-text indexing for huge documents

Thierry Florac thierry.florac@onf.fr
13 Nov 2002 15:29:26 +0100


  Hi,

I'm actually building a Zope intranet documentation web site storing
many documents ; all the documents are indexed in a ZCatalog for several
metadatas as well as for the "full-text" indexing (using TextIndexNG
product).
Some of these documents are quite huge, so indexing them can take a lot
of time.
What I'd like to do is :
 - index common metadatas as soon as a document is published (mandatory
to my site browsing)
 - update "full-text" index in a daily batch (as long as retrieving
these documents does not need to be immediate)

A solution I currently use to handle this was to create two ZCatalogs,
one for the common metadatas and another one for full-text index. This
works quite well, but makes ZCatalog queries more complex when I have to
mix indexes.

Is there any good solution to handle this kind of problem ??

Many thanks,

  Thierry

-- 
  Linux every day, keeps Dr Watson away...
  http://gpc.sourceforge.net -- http://www.ulthar.net