[Zope] Library for huge text indexes ..
Jean Jordaan
jean@upfrontsystems.co.za
Wed, 29 May 2002 16:56:01 +0200
Just spotted this and wondered if it might be of interest to people
working on Zope's indexing capacity ..
http://www.gnu.org/software/mifluz/description.en.html
The purpose of GNU mifluz is to provide a C++ library to build and
query a full text inverted index. It is dynamically updatable,
scalable (up to 1Tb indexes), uses a controlled amount of memory,
shares index files and memory cache among processes or threads and
compresses index files to 50% of the raw data. The structure of the
index is configurable at runtime and allows inclusion of relevance
ranking information. The query functions do not require to load all
the occurences of a searched term. They consume very few resources
and many searches can be run in parallel.
--
Jean Jordaan
Upfront Systems http://www.upfrontsystems.co.za