[Zope-dev] objectValues performance

[Michel Pelletier]

Brett Carter wrote:
> 
> Ok, I'll bite.  Why doesn't the standard folder scale?  Seems like a
> design flaw to me - why doesn't the default folder use catalogs or BTrees?
> -Brett

Because massive scale is not a requirment of folders, they are meant to
organize content for humans, not to be large-collection containers.  A
folder with 5000 elements is not very useful to a human.

On a similar note, create 5000 files in a linux directory on a ext2
(standard) filesystem and then type 'ls'.  You'll notice they don't
scale very well either, which is why there are filesystems like
ReiserFS.

-Michel
 
> >>>>> "Casey" == Casey Duncan <cduncan@kaivo.com> writes:
> 
>     Casey> Brett Carter wrote:
>     >>> I have a folder with greater than 5000 ZClass instances in it.  It
>     >>> takes > 5mins to do an objectValues for every object in the folder -
>     >>> is there a higher perfomance call I could make?
>     >>> -Brett
> 
>     Casey> Standard folder performance degrades pretty quickly once you get
>     Casey> a lot of objects in it. There are two solutions to this:
> 
>     Casey> Subdivide your objects into multiple folders.
>     Casey> Use a BTreeFolder which should be much faster.
> 
>     Casey> You can download the BTreeFolder product
>     Casey> here: http://www.zope.org/Members/hathawsh/BTreeFolder/
> 
>     Casey> hth,
>     Casey> Casey Duncan
> 
> _______________________________________________
> Zope-Dev maillist  -  Zope-Dev@zope.org
> http://lists.zope.org/mailman/listinfo/zope-dev
> **  No cross posts or HTML encoding!  **
> (Related lists -
>  http://lists.zope.org/mailman/listinfo/zope-announce
>  http://lists.zope.org/mailman/listinfo/zope )