[Zope] Benchmarking text indexes

Andreas Jung Andreas Jung <lists@andreas-jung.com>
Wed, 29 Jan 2003 15:20:19 +0100


I can only speak for TextIndexNG. When you use it with the standard
setting it is 50-75% faster than the old TextIndexNG. But performance
will drop when you use features like stopwords, normalization, stemming etc.

-aj

--On Mittwoch, 29. Januar 2003 09:06 -0500 Chris Muldrow 
<cmuldrow@fredericksburg.com> wrote:

> Has anyone done any benchmarking of how long the various flavors of text
> indexes for the catalog (ZCTextIndex vs TextIndex vs TextIndexNG) take to
> index themselves?
> I'm still not entirely convinced my memory leak is fixed, and I've
> definitely identified our single biggest performance problem as when
> PrincipiaSearchSource is indexed. I'm considering using two catalogs, one
> of which indexes categories and other things that we use for static
> queries and a second to handle archiving full text. The first would
> update with the Catalog-awareness, but the full-text would be indexed on
> a cron. I'm not sure about that, though--I've got to find a way to say
> "full-text index any Zclass instances that aren't in the full-text index
> already." I guess I can schedule catalog "finds" based on a date, right?
>
> Thinking out loud again...
> Chris muldrow@mac.com
>
>
> _______________________________________________
> Zope maillist  -  Zope@zope.org
> http://lists.zope.org/mailman/listinfo/zope
> **   No cross posts or HTML encoding!  **
> (Related lists -
>  http://lists.zope.org/mailman/listinfo/zope-announce
>  http://lists.zope.org/mailman/listinfo/zope-dev )




    ---------------------------------------------------------------------
   -    Andreas Jung                     http://www.andreas-jung.com   -
  -   EMail: andreas at andreas-jung.com                              -
   -            "Life is too short to (re)write parsers"               -
    ---------------------------------------------------------------------