[Zope-PTK] large number of users, how does Zope.org do it?

[Martijn Pieters]

On Wed, Apr 12, 2000 at 09:49:29AM -0400, Kevin Dangoor wrote:
>     I'm curious about this... Zope.org has a fair number of users (on the
> order of thousands), right? And each of these users has a folder in Members,
> right? Isn't the number of folders under Members getting to the point where
> performance will suffer because of the number of objects contained in there
> and the way the hash of objects is stored?
> 
>     I'm just curious of Zope.org is still using a "standard" folder/object
> manager for the members, or if it's using BTreeFolder or some other
> experimental thing...

We are having problems with the approach, it is one of the reasons that the
current Members roster (http://www.zope.org/Members/) states that is is
offline for maintanance.

I have a solution worked out for it, but no time currently to implement it (I
am not working at all until next week Wednesday). My previsous solution
involved using a _v_ variable for caching the generated data, but with 7
threads people hit threads as yet without the cache for this to have any
workable effect. I now plan to use a cache on the filesystem for this.

In our case, using a BTreeFolder wouldn't solve the problems either, as we
need to list data from all Member Folders (publicly visible or not) and all
User objects (last login for activity metrics). We still'd be waking up
12000+ objects.

-- 
Martijn Pieters
| Software Engineer    mailto:mj@digicool.com
| Digital Creations  http://www.digicool.com/
| Creators of Zope       http://www.zope.org/
|   The Open Source Web Application Server
---------------------------------------------