I have set up our Zope at https://register.funcom.com to email me whenever errors occur, and during the christmas holidays we got the following strange reports : The billing Zope at register.funcom.com reports an error The error is: KeyError : 1040726440 TRACEBACK: Traceback (innermost last): Module ZPublisher.Publish, line 98, in publish Module ZPublisher.mapply, line 88, in mapply Module ZPublisher.Publish, line 39, in call_object Module Shared.DC.Scripts.Bindings, line 252, in __call__ Module Shared.DC.Scripts.Bindings, line 283, in _bindAndExec Module Products.PythonScripts.PythonScript, line 315, in _exec Module Script (Python), line 4, in index_html <PythonScript at /newuser/index_html> Line 4 Module ZPublisher.HTTPRequest, line 1189, in __getattr__ Module ZPublisher.HTTPRequest, line 1149, in get Module Products.Sessions.SessionDataManager, line 93, in getSessionData Module Products.Sessions.SessionDataManager, line 180, in _getSessionDataObject Module Products.Transience.Transience, line 175, in new_or_existing Module Products.Transience.Transience, line 786, in get Module Products.Transience.Transience, line 599, in _getCurrentBucket Module Products.Transience.Transience, line 688, in _housekeep KeyError: 1040726440 i got a lot of these reports successively , all with the same key-error, until i restarted the server. It seems to have happened to a series of different users (different IPs , browsers, etc in the REQUESTS) The problem has not reappeared since the 24th of December, but i would really like to figure out what caused it.. Has anyone experienced anything like this? Zope Version (Zope 2.6.0 (binary release, python 2.1, linux2-x86), python 2.1.3, linux2) Python Version 2.1.3 (#1, Sep 19 2002, 13:15:46) [GCC egcs-2.91.66 19990314/Linux (egcs-1.1.2 release)] System Platform linux2 any hints are appreciated :) -- Geir Bækholt geir@funcom.com Tools/HCI-developer Tools/Billing - Product Operations Funcom Oslo
Hi Geir, This appears to be a BTrees bug. It appears that a BTree is lying about its keys. I "fixed" an earlier instance of this problem for Zope 2.6.1b1, but there are other cases where it shows up as well. If you're brave, please obtain the latest version of the "Transience" product from http://cvs.zope.org/Products/Transience/ and install it on top of the one you've got. I just made a few changes that further work around this problem. This might prevent the particular error you're seeing. I have also checked these changes into the 2.6 branch. On Thu, 2003-01-09 at 08:34, Geir Bækholt wrote:
I have set up our Zope at https://register.funcom.com to email me whenever errors occur, and during the christmas holidays we got the following strange reports :
The billing Zope at register.funcom.com reports an error The error is: KeyError : 1040726440
TRACEBACK: Traceback (innermost last):
Module ZPublisher.Publish, line 98, in publish Module ZPublisher.mapply, line 88, in mapply Module ZPublisher.Publish, line 39, in call_object Module Shared.DC.Scripts.Bindings, line 252, in __call__ Module Shared.DC.Scripts.Bindings, line 283, in _bindAndExec Module Products.PythonScripts.PythonScript, line 315, in _exec Module Script (Python), line 4, in index_html <PythonScript at /newuser/index_html> Line 4 Module ZPublisher.HTTPRequest, line 1189, in __getattr__ Module ZPublisher.HTTPRequest, line 1149, in get Module Products.Sessions.SessionDataManager, line 93, in getSessionData Module Products.Sessions.SessionDataManager, line 180, in _getSessionDataObject Module Products.Transience.Transience, line 175, in new_or_existing Module Products.Transience.Transience, line 786, in get Module Products.Transience.Transience, line 599, in _getCurrentBucket Module Products.Transience.Transience, line 688, in _housekeep
KeyError: 1040726440
i got a lot of these reports successively , all with the same key-error, until i restarted the server. It seems to have happened to a series of different users (different IPs , browsers, etc in the REQUESTS)
The problem has not reappeared since the 24th of December, but i would really like to figure out what caused it..
Has anyone experienced anything like this?
Zope Version (Zope 2.6.0 (binary release, python 2.1, linux2-x86), python 2.1.3, linux2) Python Version 2.1.3 (#1, Sep 19 2002, 13:15:46) [GCC egcs-2.91.66 19990314/Linux (egcs-1.1.2 release)] System Platform linux2
any hints are appreciated :) -- Chris McDonough <chrism@zope.com> Zope Corporation
Hello Chris, Thursday, January 9, 2003, 5:41:50 PM, you wrote:
This appears to be a BTrees bug. It appears that a BTree is lying about its keys. I "fixed" an earlier instance of this problem for Zope 2.6.1b1, but there are other cases where it shows up as well.
Thanks. I expected it to be something like this, but it is nice to get it verified from an authority ;)
If you're brave, please obtain the latest version of the "Transience" product from http://cvs.zope.org/Products/Transience/ and install it on top of the one you've got. I just made a few changes that further work around this problem. This might prevent the particular error you're seeing.
Sounds great ! :D - I really cannot afford to be very brave with this particular Zope instance, but i'll install it on one of my dev-Zopes and see how it acts under load.. Any particular ways to reproduce these kinds of bugs ? Thanks a lot, Chris.. :) -- Geir Bækholt geir@funcom.com Tools/HCI-developer Tools/Billing - Product Operations Funcom Oslo
On Thu, 2003-01-09 at 13:44, Geir Bækholt wrote:
Sounds great ! :D - I really cannot afford to be very brave with this particular Zope instance, but i'll install it on one of my dev-Zopes and see how it acts under load.. Any particular ways to reproduce these kinds of bugs ?
Not easily, unfortunately, or I would have tried to fix the bug underlying the error instead of trying to work around it... -- Chris McDonough <chrism@zope.com> Zope Corporation
Geir Bækholt wrote at 2003-1-9 14:34 +0100:
I have set up our Zope at https://register.funcom.com to email me whenever errors occur, and during the christmas holidays we got the following strange reports :
The billing Zope at register.funcom.com reports an error The error is: KeyError : 1040726440 ... Module Products.Transience.Transience, line 599, in _getCurrentBucket Module Products.Transience.Transience, line 688, in _housekeep
KeyError: 1040726440 I have recently (2002-12-28) seen similar problems in our Zope 2.5.1 installation.
"Transience" seems to get its "index" and "bucket" information inconsistent. I expect this is caused by a buggy application specific conflict resolution. I thought that the problem were fixed in Zope 2.6. But your report suggests, this is not the case. I have a patch for 2.5.1 that is able to handle the inconsistencies gracefully. Let me know when you are interested. Dieter
The transience implementation is very different in 2.5.1 and in 2.6... many problems have been fixed in 2.6, but obviously a few remain. I would be happy to apply your changes to the 2.5 branch, although of course no more releases will be made.. Dieter wrote: I have recently (2002-12-28) seen similar problems in our Zope 2.5.1 installation. "Transience" seems to get its "index" and "bucket" information inconsistent. I expect this is caused by a buggy application specific conflict resolution. I thought that the problem were fixed in Zope 2.6. But your report suggests, this is not the case. I have a patch for 2.5.1 that is able to handle the inconsistencies gracefully. Let me know when you are interested. Dieter _______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
participants (4)
-
Chris McDonough -
Dieter Maurer -
Geir Bækholt -
Geir B�kholt