[Zope-CMF] Re: Getting into ZOMA

[Ken Manheimer]

On Sun, 1 Jul 2001, ender wrote:

> On Friday 29 June 2001 09:02, Ken Manheimer wrote:
> >>
> >>It's broken, as far as i know only the search and visiting individual
> >>messages works.  (Visiting individual archive folders used to work, but
> >>i've been updating the software home out from under the instance.)  It
> >>should not be hard to fix, i've made the code available at:
> >>
> >>  http://cmf.zope.org/Members/klm/ZOMA
> >>
> >>so anyone who's interested can implement their own.  We won't be fixing it
> >>(and the site is going to have to go down, in not too long...)
> 
> i'd like to take a look but i get authentication errors on 
> MaillistArchive.tar and pop.py when logged in.

Hmmph - sorry about that!  I have explicitly enabled 'View' permission
to Anonymous and Member for both those files, so i figure you should be
able to get at them now.  I'm not certain (seems roundabout!), so let me
know if you continue to encounter problems, and i'll retry.

> i'm curious about the stress testing results and setup.
> 
>    setup
>    - what was the total size in mbs of a 130K messages around?

The db is 681 MB after pack.  The uncompressed source mboxes total around
291 MB.

>    results
>     - to what extent was performance impacted?

I'm afraid i don't have a lot to offer, there, beyond the subjective
experience of doing searches.  

I was just reminded how sensitive that experience is to packing, though. I
just packed the db (a while back i tried to copy the messages to a new
location, and neglected to pack it then), and searches that were taking 6
seconds or so are now happening in less than 1 second!  I thought i
remembered it being that fast - it's very striking to get such quick
results, for 130k messages.  For those of you that have tried it, give it
a try again.

(Note that this performance could probably be achieved, with less db
bloat, but using a remote data store like ldap, and ZODB-resident
surrogates for individual messages.  This is an interesting
alternative...)

Ken
klm@digicool.com