Communication between Zserver and ZPublisher
Hi all, I'd like to understand how the communication between the ZServer and the ZODB works. As far as i know the ZServer (Web server) talks to the ZPublisher (ORB) to get the Requested Object. But do they communicate via tcpip sockets or unix sockets? I have a problem with hanging connections (for more than 10000s) on the debug screen in zopes control panel and when all connections are jammed zope freezes. I need to find out where the connections gets stuck and why there is no timeout (i even tried to hack in the timeoutsocket module without any effect). I think i need to debug this on the os level to find out what these blocked connections are doing. But since i'm no unix system administrator i really don't know where i should start my investigation. thanks, Alexander Schad ---------------------------------------------------------------------------------------- Alexander G. Schad (Project Manager) beehive KG ---------------------------------------------------------------------------------------- mailto: ags@beehive-eu.com http://www.beehive-eu.com
Alexander Schad wrote:
Hi all, I'd like to understand how the communication between the ZServer and the ZODB works. As far as i know the ZServer (Web server) talks to the ZPublisher (ORB) to get the Requested Object. But do they communicate via tcpip sockets or unix sockets?
Neither, AFAIK.
I have a problem with hanging connections (for more than 10000s) on the debug screen in zopes control panel and when all connections are jammed zope freezes.
You using relational databases at all? What do the hung threads say they're doing on the debug info panel? cheers, Chris
At 13:17 15.09.2003 +0100, Chris Withers wrote:
Alexander Schad wrote:
Hi all, I'd like to understand how the communication between the ZServer and the ZODB works. As far as i know the ZServer (Web server) talks to the ZPublisher (ORB) to get the Requested Object. But do they communicate via tcpip sockets or unix sockets?
Neither, AFAIK.
I have a problem with hanging connections (for more than 10000s) on the debug screen in zopes control panel and when all connections are jammed zope freezes.
You using relational databases at all?
Yes an oracle DB and i'm using an external session service to store and retrieve session data using the httplib.
What do the hung threads say they're doing on the debug info panel?
for example: * Connections: * Fri Sep 12 10:28:09 2003 (11650.65s) ({'HTTP_ACCEPT_ENCODING': 'gzip,deflate,compress;q=0.9', 'SERVER_PORT': '8888', 'PATH_TRANSLATED': ... thanx, Alex
cheers,
Chris
---------------------------------------------------------------------------------------- Alexander G. Schad (Project Manager) beehive KG ---------------------------------------------------------------------------------------- mailto: ags@beehive-eu.com http://www.beehive-eu.com
Alexander Schad wrote:
Yes an oracle DB and i'm using an external session service to store and retrieve session data using the httplib.
I think using httplib to return session data is risk to put it mildly. I'd put money on the fact that it's either that or your ORacle query that's hanging...
What do the hung threads say they're doing on the debug info panel?
for example:
* Connections: * Fri Sep 12 10:28:09 2003 (11650.65s) ({'HTTP_ACCEPT_ENCODING': 'gzip,deflate,compress;q=0.9', 'SERVER_PORT': '8888', 'PATH_TRANSLATED': ...
Well, yeah, the result of that would be helpful... Chris
At 13:56 15.09.2003 +0100, Chris Withers wrote:
Alexander Schad wrote:
Yes an oracle DB and i'm using an external session service to store and retrieve session data using the httplib.
I think using httplib to return session data is risk to put it mildly. I'd put money on the fact that it's either that or your ORacle query that's hanging...
What do the hung threads say they're doing on the debug info panel?
for example: * Connections: * Fri Sep 12 10:28:09 2003 (11650.65s) ({'HTTP_ACCEPT_ENCODING': 'gzip,deflate,compress;q=0.9', 'SERVER_PORT': '8888', 'PATH_TRANSLATED': ...
Well, yeah, the result of that would be helpful...
here you are... * Fri Sep 12 10:28:09 2003 (11650.65s) ({'HTTP_ACCEPT_ENCODING': 'gzip,deflate,compress;q=0.9', 'SERVER_PORT': '8888', 'PATH_TRANSLATED': '/VirtualHostBase/http/zope.sk-koeln.de:80/VirtualHostRoot/mysk/willkommen.html', 'HTTP_ACCEPT': 'text/xml,application/xml,application/xhtml+xml,text/html;q=0.9,text/plain;q=0.8,video/x-mng,image/png,image/jpeg,image/gif;q=0.2,*/*;q=0.1', 'GATEWAY_INTERFACE': 'CGI/1.1', 'HTTP_X_FORWARDED_HOST': 'zope.sk-koeln.de', 'HTTP_ACCEPT_LANGUAGE': 'en-us,en;q=0.5', 'HTTP_X_FORWARDED_FOR': '172.17.1.17', 'REMOTE_ADDR': '127.0.0.1', 'SERVER_NAME': 'zopedevel.skk-eb', 'HTTP_USER_AGENT': 'Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.4b) Gecko/20030516 Mozilla Firebird/0.6', 'HTTP_ACCEPT_CHARSET': 'ISO-8859-1,utf-8;q=0.7,*;q=0.7', 'CONNECTION_TYPE': 'close', 'channel.creation_time': 1063355289, 'SERVER_PROTOCOL': 'HTTP/1.1', 'PATH_INFO': '/VirtualHostBase/http/zope.sk-koeln.de:80//VirtualHostRoot/mysk/willkommen.html', 'HTTP_HOST': '127.0.0.1:8888', 'REQUEST_METHOD': 'GET', 'SCRIPT_NAME': '', 'SERVER_SOFTWARE': 'Zope/(Zope 2.4.4 (source release, python 2.1, linux2), python 2.1.3, linux2) ZServer/1.1b1', 'HTTP_COOKIE': 'skkauth="b2JzOnNraXN0dG9sbCE%3D%0A"; SKKSess="94d655ed-ac11-0167-0128-3826490e6f66"; _ZopeId="47149791A0-aQycDJiI"', 'HTTP_X_FORWARDED_SERVER': 'zope.sk-koeln.de'}, {'_ZopeId': '47149791A0-aQycDJiI', 'AUTHENTICATION_PATH': 'VHM//', 'sessUserID': '-1', 'RESPONSE': ZServerHTTPResponse(''), 'PARENTS': [<Folder instance at 8b9bac8>, <Application instance at 8b7ed38>], 'SKKSess': '94d655ed-ac11-0167-0128-3826490e6f66', 'sessEnded': 0, 'dontRedirect': '0', 'SERVER_URL': 'http://zope.sk-koeln.de', 'VirtualRootPhysicalPath': ('',), 'PUBLISHED': <DTMLDocument instance at 8f3cc78>, 'URL': 'http://zope.sk-koeln.de/mysk/willkommen.html', 'AUTHENTICATED_USER': xxx, 'TraversalRequestNameStack': []}) (5202)
Chris
---------------------------------------------------------------------------------------- Alexander G. Schad (Project Manager) beehive KG ---------------------------------------------------------------------------------------- mailto: ags@beehive-eu.com http://www.beehive-eu.com
Alexander Schad wrote:
Hi all, I'd like to understand how the communication between the ZServer and the ZODB works. As far as i know the ZServer (Web server) talks to the ZPublisher (ORB) to get the Requested Object. But do they communicate via tcpip sockets or unix sockets? I have a problem with hanging connections (for more than 10000s) on the debug screen in zopes control panel and when all connections are jammed zope freezes. I need to find out where the connections gets stuck and why there is no timeout (i even tried to hack in the timeoutsocket module without any effect). I think i need to debug this on the os level to find out what these blocked connections are doing. But since i'm no unix system administrator i really don't know where i should start my investigation.
ZServer, ZPublisher, and ZODB talk to each other through Python objects rather than OS-level mechanisms. Sockets are only involved if you introduce ZEO into the mix. There is a maximum of 7 connections open at a time. If Zope leaks connections, Zope will hang the way you describe once 7 connections have been leaked. Running into this is quite unlikely unless you are writing Zope products or are using products that do the wrong thing with database connections. What products are you using? What version of Zope? What OS? Shane
At 09:54 15.09.2003 -0400, Shane Hathaway wrote:
Alexander Schad wrote:
Hi all, I'd like to understand how the communication between the ZServer and the ZODB works. As far as i know the ZServer (Web server) talks to the ZPublisher (ORB) to get the Requested Object. But do they communicate via tcpip sockets or unix sockets? I have a problem with hanging connections (for more than 10000s) on the debug screen in zopes control panel and when all connections are jammed zope freezes. I need to find out where the connections gets stuck and why there is no timeout (i even tried to hack in the timeoutsocket module without any effect). I think i need to debug this on the os level to find out what these blocked connections are doing. But since i'm no unix system administrator i really don't know where i should start my investigation.
ZServer, ZPublisher, and ZODB talk to each other through Python objects rather than OS-level mechanisms. Sockets are only involved if you introduce ZEO into the mix.
There is a maximum of 7 connections open at a time. If Zope leaks connections, Zope will hang the way you describe once 7 connections have been leaked. Running into this is quite unlikely unless you are writing Zope products or are using products that do the wrong thing with database connections. What products are you using? What version of Zope? What OS?
Products: CallProfiler, PageTemplates, SiteAccess, StandardCacheManagers, ZopeTutorial CookieCrumbler, PluginIndexes, SKKCookieCrumbler, stripogram, ZOracleDA CoreSessionTracking, PythonScripts, SKKHotfixPatches, ExternalMethod, LocalFS, PythonScriptsImports , SKKSiteAccess, ZSQLMethods, Globo5, MailHost, QGo, ZCatalog, Hotfix_2002-03-01, MetaPublisher, ReplaceSupport, SKKUserFolder, ZCVSFolder Hotfix_2002-04-15, MIMETools, RevisionManager, SOAPMethod, ZGadflyDA, Hotfix_2002-06-14 OFSP, RevisionObjects, SSLAbsoluteURL, ZopeTree Zope version: (Zope 2.4.4 (source release, python 2.1, linux2), python 2.1.3, linux2) Python version: 2.1.3 (#2, Jan 8 2003, 13:24:59) [GCC 2.96 20000731 (Red Hat Linux 7.2 2.96-108.7.2)] RedHat 7.2 Linux 3.4.21 Cheers, Alex
Shane
---------------------------------------------------------------------------------------- Alexander G. Schad (Project Manager) beehive KG ---------------------------------------------------------------------------------------- mailto: ags@beehive-eu.com http://www.beehive-eu.com
Alexander Schad wrote:
Zope version: (Zope 2.4.4 (source release, python 2.1, linux2), python 2.1.3, linux2)
You're going to have a hard time debugging this if you stick with Zope 2.4. Would it be difficult to upgrade? Also, what are all those "SKK" products? Shane
At 10:18 15.09.2003 -0400, Shane Hathaway wrote:
Alexander Schad wrote:
Zope version: (Zope 2.4.4 (source release, python 2.1, linux2), python 2.1.3, linux2)
You're going to have a hard time debugging this if you stick with Zope 2.4. Would it be difficult to upgrade? I have checked the changes log and didn't find anything concerning my problem. So i decided to stick with 2.4.4 because i didn't want to cause more problems...
Also, what are all those "SKK" products?
SKKCookieCrumbler is a patched CookieCrumbler SKKHotfixPatches containes a patch for the Cahceable Object SKKSiteAccess is a patched SiteAccess Product SKKUserFolder is a self-writen userfolder Alex
Shane
---------------------------------------------------------------------------------------- Alexander G. Schad (Project Manager) beehive KG ---------------------------------------------------------------------------------------- mailto: ags@beehive-eu.com http://www.beehive-eu.com
On Mon, Sep 15, 2003 at 01:49:50PM +0200, Alexander Schad wrote:
Hi all, I'd like to understand how the communication between the ZServer and the ZODB works. As far as i know the ZServer (Web server) talks to the ZPublisher (ORB) to get the Requested Object. But do they communicate via tcpip sockets or unix sockets? They communicate by Python Method call :)
From 100km overhead it looks like that: ZServer gets a request, handles all the protocol specific stuff, and gives it to ZPublisher. ZPublisher than gets the application object it publishes and traverses the tree to find the right method to call. The application object is usually (in the Zope case) fetched from the ZODB.
Andreas Kostyrka
participants (4)
-
Alexander Schad -
andreas＠ae.mtg.co.at -
Chris Withers -
Shane Hathaway