I have the /Members folder of a CMF site mounted in its own separate ZODB called MemberData.fs. The file keeps growing at an alarming rate of about 400MB a day until it eventually reaches the 2GB limit them i get loads of MemberData.fs.trxxxx files There's no extra data explicitly being put into the member homes, if i go to pack database it reduces back to about 50MB Does anyone have the slightest clue what could be going on?!?!?!?!?
Declan Shanaghy wrote:
I have the /Members folder of a CMF site mounted in its own separate ZODB called MemberData.fs.
The file keeps growing at an alarming rate of about 400MB a day until it eventually reaches the 2GB limit them i get loads of MemberData.fs.trxxxx files
There's no extra data explicitly being put into the member homes, if i go to pack database it reduces back to about 50MB
Does anyone have the slightest clue what could be going on?!?!?!?!?
Two things: - Do you have some kind of "member activity tracking" code which would be writing into the member folder on each request? - You need to run with a python which is enabled for large files. E.g., try: $ /path/to/bin/python \ /path/to/lib/python2.3/tests/test_largefile.py If that shows any errors, you need to use a different python (the "recommended best practice" is to use a separate python from the one which your OS vendor ships, anyway). Tres. -- =============================================================== Tres Seaver tseaver@zope.com Zope Corporation "Zope Dealers" http://www.zope.com
No i dont have any sort of member tracking code. I already ran that script and i know my system cannot handle large files. I dont need to handle large files. i need to find out what is being written into the MemberData.fs file. Can i monitor the data being written into the file or anything? --- Tres Seaver <tseaver@zope.com> wrote:
Declan Shanaghy wrote:
I have the /Members folder of a CMF site mounted in its own separate ZODB called MemberData.fs.
The file keeps growing at an alarming rate of about 400MB a day until it eventually reaches the 2GB limit them i get loads of MemberData.fs.trxxxx files
There's no extra data explicitly being put into the member homes, if i go to pack database it reduces back to about 50MB
Does anyone have the slightest clue what could be going on?!?!?!?!?
Two things:
- Do you have some kind of "member activity tracking" code which would be writing into the member folder on each request?
- You need to run with a python which is enabled for large files. E.g., try:
$ /path/to/bin/python \
/path/to/lib/python2.3/tests/test_largefile.py
If that shows any errors, you need to use a different python (the "recommended best practice" is to use a separate python from the one which your OS vendor ships, anyway).
Tres. --
===============================================================
Tres Seaver tseaver@zope.com Zope Corporation "Zope Dealers" http://www.zope.com
[Declan Shanaghy]
No i dont have any sort of member tracking code.
I already ran that script and i know my system cannot handle large files.
I dont need to handle large files. i need to find out what is being written into the MemberData.fs file.
Can i monitor the data being written into the file or anything?
You could use the fsdump.py tool to examine the transactions. That should give you good clues. Useful info about FileStorage tools can be found here: http://zope.org/Wikis/ZODB/FileStorageBackup
Declan Shanaghy wrote at 2004-11-11 20:02 -0800:
I have the /Members folder of a CMF site mounted in its own separate ZODB called MemberData.fs.
The file keeps growing at an alarming rate of about 400MB a day until it eventually reaches the 2GB limit them i get loads of MemberData.fs.trxxxx files
Use the "fsdump" utilitiy to look into your storage file. It will show you the classes of the objects dumped into the storage. This may give some glue of what is going wrong. -- Dieter
participants (4)
-
Declan Shanaghy -
Dieter Maurer -
Tim Peters -
Tres Seaver