Ordered folder growing FAST
I have an ORDERED folder with tens of thousands of elements inside of it. Each time I add a new element, de database grows a lot. I guess some internal structure is not actually a BTREE and each time it is modified, all of it must be persisted to disk again. Am I right?. Is this a known issue?. Any plan to solve it?. Would you accept a patch?. I am using ZOPE 2.13.21, but data.fs has been thru tons of zope versions since 2000 or so :). -- Jesús Cea Avión _/_/ _/_/_/ _/_/_/ jcea@jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/ Twitter: @jcea _/_/ _/_/ _/_/_/_/_/ jabber / xmpp:jcea@jabber.org _/_/ _/_/ _/_/ _/_/ _/_/ "Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/ "My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/ "El amor es poner tu felicidad en la felicidad de otro" - Leibniz
On 05/04/14 00:54, Jesus Cea wrote:
I have an ORDERED folder with tens of thousands of elements inside of it. Each time I add a new element, de database grows a lot. I guess some internal structure is not actually a BTREE and each time it is modified, all of it must be persisted to disk again.
Ok, checking the sourcecode there is no BTREE at all anywhere, so any change must dump the entire huge object again. I was probably using "BTreeFolder" product sometime in the past. Checking around I found "BTreeFolder2". Last release is in 2011. Is that compatible with current Zope 2.13.21?. <https://pypi.python.org/pypi/Products.BTreeFolder2>. -- Jesús Cea Avión _/_/ _/_/_/ _/_/_/ jcea@jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/ Twitter: @jcea _/_/ _/_/ _/_/_/_/_/ jabber / xmpp:jcea@jabber.org _/_/ _/_/ _/_/ _/_/ _/_/ "Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/ "My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/ "El amor es poner tu felicidad en la felicidad de otro" - Leibniz
On Sat, Apr 05, Jesus Cea wrote:
Checking around I found "BTreeFolder2". Last release is in 2011. Is that compatible with current Zope 2.13.21?. <https://pypi.python.org/pypi/Products.BTreeFolder2>.
We are using BTreeFolder2 with Zope 2.13. Unfortunately I can't remember which minor version we're running, and can't check before Monday. /Kristian
participants (2)
-
Jesus Cea -
Kristian Thy