[Zope] Benchmarking text indexes

Chris Muldrow cmuldrow@fredericksburg.com
Wed, 29 Jan 2003 09:06:11 -0500


Has anyone done any benchmarking of how long the various flavors of text
indexes for the catalog (ZCTextIndex vs TextIndex vs TextIndexNG) take to
index themselves? 
I'm still not entirely convinced my memory leak is fixed, and I've
definitely identified our single biggest performance problem as when
PrincipiaSearchSource is indexed. I'm considering using two catalogs, one of
which indexes categories and other things that we use for static queries and
a second to handle archiving full text. The first would update with the
Catalog-awareness, but the full-text would be indexed on a cron. I'm not
sure about that, though--I've got to find a way to say "full-text index any
Zclass instances that aren't in the full-text index already." I guess I can
schedule catalog "finds" based on a date, right?

Thinking out loud again...
Chris muldrow@mac.com