[Zope] Delayed full-text indexing for huge documents

Andreas Jung Andreas Jung <lists@andreas-jung.com>
Wed, 13 Nov 2002 15:33:13 +0100


There is a QueuedCatalog product in progress (by ZC) that
seem indexes objects in the background by a dedicated thread.
But I don't know about the status (might be for Zope 3 only).

-aj

--On Mittwoch, 13. November 2002 15:29 +0100 Thierry Florac 
<thierry.florac@onf.fr> wrote:

>
>   Hi,
>
> I'm actually building a Zope intranet documentation web site storing
> many documents ; all the documents are indexed in a ZCatalog for several
> metadatas as well as for the "full-text" indexing (using TextIndexNG
> product).
> Some of these documents are quite huge, so indexing them can take a lot
> of time.
> What I'd like to do is :
>  - index common metadatas as soon as a document is published (mandatory
> to my site browsing)
>  - update "full-text" index in a daily batch (as long as retrieving
> these documents does not need to be immediate)
>
> A solution I currently use to handle this was to create two ZCatalogs,
> one for the common metadatas and another one for full-text index. This
> works quite well, but makes ZCatalog queries more complex when I have to
> mix indexes.
>
> Is there any good solution to handle this kind of problem ??
>
> Many thanks,
>
>   Thierry
>
> --
>   Linux every day, keeps Dr Watson away...
>   http://gpc.sourceforge.net -- http://www.ulthar.net
>
>
> _______________________________________________
> Zope maillist  -  Zope@zope.org
> http://lists.zope.org/mailman/listinfo/zope
> **   No cross posts or HTML encoding!  **
> (Related lists -
>  http://lists.zope.org/mailman/listinfo/zope-announce
>  http://lists.zope.org/mailman/listinfo/zope-dev )




    ---------------------------------------------------------------------
   -    Andreas Jung                     http://www.andreas-jung.com   -
  -   EMail: andreas at andreas-jung.com                              -
   -            "Life is too short to (re)write parsers"               -
    ---------------------------------------------------------------------