[Zope] urgent stability problem on production site

30 Jan 2002

      Hi,

the ZPatterns list seems to be misconfigured - I cannot reach the list
or someone at eby-sarna.com. So I post my problem here:

Today we got online with a customer site and unfortunately instantly got a
problem with ZPatterns or TransactionAgents, I don't really know.

The site is quite heavily used - 40000 users that got a registration
this night try to change their username and password now. All works
very well and fast.

The problem is that the Zope process dies once in a while - a while
varies from 20 seconds to 20 minutes. I saw a relationship between
login tries (login form) and the Zope process dying. Unfortunately
this happens randomly - always when Zope dies shortly before that
somebody tried a login. At the other side many logins work without Zope
dying.

The error log shows:

2002-01-30 11:02:25.627043500 2002-01-30T10:02:25 INFO(0) Z2 CONFLICT Competing writes at, /galileo/ssl/l
ogin/
2002-01-30 11:02:25.627844500 Traceback (innermost last):
2002-01-30 11:02:25.627849500   File /web/Zope-2.4.3/lib/python/ZPublisher/Publish.py, line 175, in publi
sh
2002-01-30 11:02:25.627852500   File /web/Zope-2.4.3/lib/python/Zope/__init__.py, line 240, in commit
2002-01-30 11:02:25.627855500   File /web/Zope-2.4.3/lib/python/Products/TransactionAgents/__init__.py, l
ine 54, in new_commit
2002-01-30 11:02:25.627858500   File /web/Zope-2.4.3/lib/python/ZODB/Transaction.py, line 302, in commit
2002-01-30 11:02:25.627861500   File /web/Zope-2.4.3/lib/python/ZODB/Connection.py, line 324, in commit
2002-01-30 11:02:25.627889500 ConflictError: '\x00\x00\x00\x00\x00\x00\x00\x02'
2002-01-30 11:02:25.627891500 
2002-01-30 11:02:25.627892500 
2002-01-30 11:02:26.203482500 ------
2002-01-30 11:02:26.203488500 2002-01-30T10:02:26 INFO(0) Z2 CONFLICT Competing writes at, /galileo/galil
eo_press/
2002-01-30 11:02:26.204217500 Traceback (innermost last):
2002-01-30 11:02:26.204220500   File /web/Zope-2.4.3/lib/python/ZPublisher/Publish.py, line 175, in publi
sh
2002-01-30 11:02:26.204223500   File /web/Zope-2.4.3/lib/python/Zope/__init__.py, line 240, in commit
2002-01-30 11:02:26.204226500   File /web/Zope-2.4.3/lib/python/Products/TransactionAgents/__init__.py, l
ine 54, in new_commit
2002-01-30 11:02:26.204230500   File /web/Zope-2.4.3/lib/python/ZODB/Transaction.py, line 302, in commit
2002-01-30 11:02:26.204233500   File /web/Zope-2.4.3/lib/python/ZODB/Connection.py, line 324, in commit
2002-01-30 11:02:26.204346500 ConflictError: '\x00\x00\x00\x00\x00\x00\x00\x02'
2002-01-30 11:02:26.204349500 
2002-01-30 11:02:26.204350500 
2002-01-30 11:02:37.190244500 ------
2002-01-30 11:02:37.190248500 2002-01-30T10:02:37 INFO(0) Z2 CONFLICT Competing writes at, /galileo/ssl/s
uche
2002-01-30 11:02:37.190822500 Traceback (innermost last):
2002-01-30 11:02:37.190824500   File /web/Zope-2.4.3/lib/python/ZPublisher/Publish.py, line 175, in publi
sh
2002-01-30 11:02:37.190827500   File /web/Zope-2.4.3/lib/python/Zope/__init__.py, line 240, in commit
2002-01-30 11:02:37.190830500   File /web/Zope-2.4.3/lib/python/Products/TransactionAgents/__init__.py, l
ine 54, in new_commit
2002-01-30 11:02:37.190833500   File /web/Zope-2.4.3/lib/python/ZODB/Transaction.py, line 302, in commit
2002-01-30 11:02:37.190836500   File /web/Zope-2.4.3/lib/python/ZODB/Connection.py, line 324, in commit
2002-01-30 11:02:37.190851500 ConflictError: '\x00\x00\x00\x00\x00\x00\x00\x00'
2002-01-30 11:02:37.190853500 
2002-01-30 11:02:37.190854500 
2002-01-30 11:03:39.067913500 ------
2002-01-30 11:03:39.067920500 2002-01-30T10:03:39 INFO(0) Z2 CONFLICT Competing writes at, /galileo/ssl/s
hop/warenkorb/
2002-01-30 11:03:39.070648500 Traceback (innermost last):
2002-01-30 11:03:39.070650500   File /web/Zope-2.4.3/lib/python/ZPublisher/Publish.py, line 175, in publi
sh
2002-01-30 11:03:39.070653500   File /web/Zope-2.4.3/lib/python/Zope/__init__.py, line 240, in commit
2002-01-30 11:03:39.070656500   File /web/Zope-2.4.3/lib/python/Products/TransactionAgents/__init__.py, l
ine 54, in new_commit
2002-01-30 11:03:39.070660500   File /web/Zope-2.4.3/lib/python/ZODB/Transaction.py, line 302, in commit
2002-01-30 11:03:39.070663500   File /web/Zope-2.4.3/lib/python/ZODB/Connection.py, line 324, in commit
2002-01-30 11:03:39.070681500 ConflictError: '\x00\x00\x00\x00\x00\x00\x00\n'
2002-01-30 11:03:39.070683500 
2002-01-30 11:03:39.070684500 
!tai
2002-01-30 11:04:11.248404500 ------
2002-01-30 11:04:11.248411500 2002-01-30T10:04:11 INFO(0) Z2 CONFLICT Competing writes at, /galileo/galil
eo_computing/
2002-01-30 11:04:11.323482500 Traceback (innermost last):
2002-01-30 11:04:11.323488500   File /web/Zope-2.4.3/lib/python/ZPublisher/Publish.py, line 175, in publi
sh
2002-01-30 11:04:11.323492500   File /web/Zope-2.4.3/lib/python/Zope/__init__.py, line 240, in commit
2002-01-30 11:04:11.323495500   File /web/Zope-2.4.3/lib/python/Products/TransactionAgents/__init__.py, l
ine 54, in new_commit
2002-01-30 11:04:11.323498500   File /web/Zope-2.4.3/lib/python/ZODB/Transaction.py, line 302, in commit
2002-01-30 11:04:11.323501500   File /web/Zope-2.4.3/lib/python/ZODB/Connection.py, line 420, in commit
2002-01-30 11:04:11.323554500     (Info: (('BTrees.OOBTree', 'OOBTree'), '\x00\x00\x00\x00\x00\x00\x00\x0
3', ''))
2002-01-30 11:04:11.323557500   File /web/Zope-2.4.3/lib/python/Products/CoreSessionTracking/SessionStora
ge.py, line 186, in store
2002-01-30 11:04:11.323561500     (Object: SessionStorage)
2002-01-30 11:04:11.323562500 ConflictError: ('\x03B`|"\xd2\x85\xbb', '\x03B`|+"\xdf*')

We use LoginManager with some modifications made by Joachim
Schmitz. The LoginManager is the only thing that uses ZPatterns
anymore - so I think there lies the source of the problem.
I don't know why TransActionAgents try to do something with the ZODB -
all authenticatios are done against a MySQL database.

Maybe Joachim may assist to explain the changes made to LoginManager.

Here are our oftware versions:

Zope 2.4.3
TransactionAgents-0.0.4
LoginManager-0-8-8b1 (patched)

for database connectivity:
MySQL-python-0.9.1
ZMySQLDA-2.0.8

Python 2.1.1 (#1, Aug 29 2001, 15:06:31) 
[GCC 2.95.4 20010810 (Debian prerelease)] on linux2

+ CoreSessionTracking 0.9

Here is a traceback from userland:

Traceback (innermost last):
  File /web/Zope-2.4.3/lib/python/ZPublisher/Publish.py, line 223, in 
publish_module
  File /web/Zope-2.4.3/lib/python/ZPublisher/Publish.py, line 187, in publish
  File /web/Zope-2.4.3/lib/python/Zope/__init__.py, line 226, in 
zpublisher_exception_hook
    (Object: login)
  File /web/Zope-2.4.3/lib/python/ZPublisher/Publish.py, line 162, in publish
  File /web/Zope-2.4.3/lib/python/ZPublisher/BaseRequest.py, line 450, in 
traverse
  File /web/Zope-2.4.3/lib/python/Products/LoginManager/LoginManager.py, 
line 236, in validate
    (Object: acl_users)
  File /web/Zope-2.4.3/lib/python/Products/LoginManager/LoginMethods.py, 
line 129, in findLogin
    (Object: Session_USER Login)
  File /web/Zope-
2.4.3/lib/python/Products/CoreSessionTracking/SessionDataManager.py, line 
258, in getSessionData
    (Object: sdm)
  File /web/Zope-
2.4.3/lib/python/Products/CoreSessionTracking/SessionDataManager.py, line 
390, in _getSessionDataObject
    (Object: sdm)
  File /web/Zope-
2.4.3/lib/python/Products/CoreSessionTracking/LowConflictConnection.py, 
line 107, in setstate
  File /web/Zope-
2.4.3/lib/python/Products/CoreSessionTracking/SessionStorage.py, line 156, 
in load
    (Object: SessionStorage)
KeyError:        

Does anybody have a hint how to solve this problem?

Regards, Frank
-- 
CTO   fte@Lightwerk.com         http://www.Lightwerk.com/
Fax: +49-2434-80 07 94           Phone: +49-2434-80 07 81
Lightwerk GmbH * An der Kull 11 * 41844 Wegberg * Germany
Besuchen Sie uns auf der CeBIT:  Halle 6, Stand F68 / 595

[Zope] urgent stability problem on production site

Frank Tegtmeyer