June 2005 - Zope - Zope lists

plone site & dreamweaver
by sguglia＠arrows.it 28 Jun '05

28 Jun '05

Hello! I need to use dreamweaver to manage a plone site but I cannot find a detailed howto. Any help? thank you, stefano.

1 0

loading an url from a restricted python script
by santiago 28 Jun '05

28 Jun '05

hello I'm writting a restricted python script (in the zmi) and I wish to load an url that the user gives to me in order to diplay it back, inside my web page. is there a zope method that I can use, or must I relay on an external python script and use urllib ? thanks

3 2

RE: [Zope] Tweaking Zope DB- and connection parameters
by Pascal Peregrina 28 Jun '05

28 Jun '05

zserver-threads and pool-size should be almost the same. Each HTTP request from Apache to Zope uses a Connection object bound to a Transaction object. As each Connection object has its own cache, then if the connection pool size is much higher than the number of zsever threads, you could end up using new connections with empty cache when it's not necessary... This will make the request response time slower (cause the connection will need to get all objects from ZODB) and will end up using unecessary memory (cause all connection caches will be caching objects). I would recommend pool-size 8 if you keep zserver-threads to 5. (I don't know why pool-size must be a little higher than threads, but the default configuration is 4 threads and 7 connections, so...) Then try increasing the cache size, because if you have lots of different websites, caching 500 objects will probably cause each connection to often load objects from ZODB (cache miss). To monitor that you can use Control Panel -> Database Management -> Main -> Cache Parameters For each connection, if the number of active objects hits your 500 limit, then it may be a good idea to increase it. But of course this will depend oh the available memory you have. Hope this helps. Pascal -----Message d'origine----- De : zope-bounces(a)zope.org [mailto:zope-bounces@zope.org]De la part de Germer, Carsten Envoyé : mardi 28 juin 2005 11:32 À : zope list user Objet : [Zope] Tweaking Zope DB- and connection parameters Hello everyone, I'm trying to figure out what I can set all (I know) Zope Parameters to to get a good overall performance on our "old" live installation. We have a new System with upgraded Zope and the like in the making but untill then I'm trying to keep what is up smooth and stable. Machine: Dual Pentium with 4Gig Ram running on Suse Linux. Zope 2.7.2 with Python 2.3.4 and ZMS for the Sites. There's a recent Apache 1.3.x in Front for caching and like 25 Sites running on the system, some very rarely visited some more loaded. While running the system with out-of-the-box-parameters at times of high load the RAM went full, the machine started swapping and spiraling down so I started to set limits in Apache and Zope. I was mostly just guessing! Apache is set to "MaxClients 50" Zope.conf has set "zserver-threads 5" and <zodb_db main> cache-size 500 pool-size 25 ... </zodb_db> With this settings the machine tops at load around 1.8 - 2 and no swapping takes place *puuh* but still users sometimes, too often for users taste, get to wait a minute and longer for their page. For me it tastes like a garbage collection or whatnot because after 5-20 minutes everything is fine again for an hour or two... - Apaches "MaxClients" is set for general limit - zserver-threads: How many ppl, approx., can connect with this set to 5? Would be good to synchronize this with the apache settings somehow? - cache-size: This is per DB connection (pool-size) as I have learned, I did set this down to limit memory usage - pool-size: number of concurrent DB-Connections as I learned. Does every concurrent connection have to have it's own db-connection or do N zserver-threads share one? What I'm looking for is general advice how these parameters work and can be set for best cooperation. Or if there are other Params that I have missed yet ;) E.g. "every zserver-thread uses one db-connection and can server one user so for 50 concurrent users you have to set everything to 50 and tweak cache-size according to 'Cache Parameters' in the Zope config and your RAM-load behaves" Which is nonsense I bet but something like that would help me great time. Thanks in Advance for any Help! /Carsten ------------------------------------------------------------------------ Carsten Germer Deutsches Elektronen Synchrotron (Web-Office, IT) phone: +49-40-8998-1661 Notkestr. 85 web: http://wof.desy.de 22607 Hamburg e-mail: carsten.germer(a)desy.de Germany ------------------------------------------------------------------------ _______________________________________________ Zope maillist - Zope(a)zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev ) ********************************************************************** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This footnote also confirms that this email message has been swept by MIMEsweeper for the presence of computer viruses. www.mimesweeper.com **********************************************************************

1 0

Tweaking Zope DB- and connection parameters
by Germer, Carsten 28 Jun '05

28 Jun '05

Hello everyone, I'm trying to figure out what I can set all (I know) Zope Parameters to to get a good overall performance on our "old" live installation. We have a new System with upgraded Zope and the like in the making but untill then I'm trying to keep what is up smooth and stable. Machine: Dual Pentium with 4Gig Ram running on Suse Linux. Zope 2.7.2 with Python 2.3.4 and ZMS for the Sites. There's a recent Apache 1.3.x in Front for caching and like 25 Sites running on the system, some very rarely visited some more loaded. While running the system with out-of-the-box-parameters at times of high load the RAM went full, the machine started swapping and spiraling down so I started to set limits in Apache and Zope. I was mostly just guessing! Apache is set to "MaxClients 50" Zope.conf has set "zserver-threads 5" and <zodb_db main> cache-size 500 pool-size 25 ... </zodb_db> With this settings the machine tops at load around 1.8 - 2 and no swapping takes place *puuh* but still users sometimes, too often for users taste, get to wait a minute and longer for their page. For me it tastes like a garbage collection or whatnot because after 5-20 minutes everything is fine again for an hour or two... - Apaches "MaxClients" is set for general limit - zserver-threads: How many ppl, approx., can connect with this set to 5? Would be good to synchronize this with the apache settings somehow? - cache-size: This is per DB connection (pool-size) as I have learned, I did set this down to limit memory usage - pool-size: number of concurrent DB-Connections as I learned. Does every concurrent connection have to have it's own db-connection or do N zserver-threads share one? What I'm looking for is general advice how these parameters work and can be set for best cooperation. Or if there are other Params that I have missed yet ;) E.g. "every zserver-thread uses one db-connection and can server one user so for 50 concurrent users you have to set everything to 50 and tweak cache-size according to 'Cache Parameters' in the Zope config and your RAM-load behaves" Which is nonsense I bet but something like that would help me great time. Thanks in Advance for any Help! /Carsten ------------------------------------------------------------------------ Carsten Germer Deutsches Elektronen Synchrotron (Web-Office, IT) phone: +49-40-8998-1661 Notkestr. 85 web: http://wof.desy.de 22607 Hamburg e-mail: carsten.germer(a)desy.de Germany ------------------------------------------------------------------------

1 0

Sharing global data between threads / locking a method
by Max M 28 Jun '05

28 Jun '05

I have a synkronisation script that I run every 10 minutes via wget from a cron job. Sometimes the script runs longer than 10 minutes. In that case I would like to return a page to wget, but not run the actual script. So in a external method/module I have a function like this: BUSY_STATE = 0 def sync_in_progress(busy=None): global BUSY_STATE if busy is None: return BUSY_STATE else: BUSY_STATE = busy The idea is that BUSY_STATE is a global value shared between all threads, and if the sync_test() function below is called while it is allready running in another thread, it will just return 'Sync allready in progress'. I then wrap the actual sync code like this: def long_test_function(): # just to kill time t = Timer('Loop time') for i in xrange(10**7): d = 7*8 e = 7*8 print t.time() return d def sync_test(self): if not sync_in_progress(): sync_in_progress(1) long_test_function() # placeholder for the real sync code sync_in_progress(0) return 'Sync done' else: return 'Sync allready in progress' But it seems that the new method merely waits until the first one has completed. So it allways returns 'Sync done' and calls long_test_function() What am I misunderstanding here? Isn't it the right way to share global data? Or is there some kind of locking going on under my nose that I am to blind to see. -- hilsen/regards Max M, Denmark http://www.mxm.dk/ IT's Mad Science

4 4

CMF 1.5.2beta released
by Jens Vagelpohl 28 Jun '05

28 Jun '05

Zope Corporation is pleased to announce the release of version 1.5.2beta of the Zope Content Management Framework (CMF). This release is intended for testing purposes only; we do not recommend deploying it to production servers. The final release of version 1.5.2 is expected mid-July 2005. What is the CMF? The Zope Content Management Framework provides a set of services and content objects useful for building highly dynamic, content-oriented portal sites. As packaged, the CMF generates a site much like the Zope.org site. The CMF is intended to be easily customizable, in terms of both the types of content used and the policies and services it provides. Where do I get it? Download it from http://zope.org/Products/CMF/CMF-1.5.2beta Points of interest include: - "Windows ZIP file", http://zope.org/Products/CMF/CMF-1.5.2beta/CMF-1.5.2beta.zip - "Unix tar/gzip archive", http://zope.org/Products/CMF/CMF-1.5.2beta/CMF-1.5.2beta.tar.gz . - "Release notes", http://zope.org/Products/CMF/CMF-1.5.2beta/README.txt - "Change history", http://zope.org/Products/CMF/CMF-1.5.2beta/CHANGES.txt - "Installation instructions", http://zope.org/Products/CMF/CMF-1.5.2beta/INSTALL.txt Where do I go to learn more? The CMF mailing list (zope-cmf(a)zope.org) has many participants who are active in supporting the CMF. ...to report bugs? The "CMF Collector":http://zope.org/Collectors/CMF is the place to report bugs (please search for existing reports of your issue first!)

1 0

RE: [Zope] Sharing global data between threads / locking a method
by Pascal Peregrina 27 Jun '05

27 Jun '05

I think that storing an "isMyProcessingStarted" property would not work, because the transaction that modifies the property value would not be committed until the long processing is done, so when the next transaction that reads this value starts (if this happens before the previous one has finished), it would still see the old value. If you are using a single Zope instance, you can try something nasty like : #to read the value : try: test=_isMyProcessingStarted except: test=0 #to write the value : import __builtin__ __builtin__._isMyProcessingStarted=<value> Hope that helps... Pascal -----Message d'origine----- De : zope-bounces+pperegrina=lastminute.com(a)zope.org [mailto:zope-bounces+pperegrina=lastminute.com@zope.org]De la part de Jonathan Envoyé : lundi 27 juin 2005 17:00 À : Jim Abramson; zope(a)zope.org; Max M Objet : Re: [Zope] Sharing global data between threads / locking a method ----- Original Message ----- From: "Jim Abramson" <jabramson(a)wgen.net> >> A possible solution: create a property field on the folder >> where the external methods are stored. Have your external >> method update this property field when the external method >> starts and again when it exits. This way you can test >> whether or not the external method is currently in operation. >> You could store this property field on a temp_folder for >> faster performance. > > Curious, > > - to save variables in this way, must a Folder property be used, or > would a class variable set on something that extends Folder work the > same? You can store the property field on/in any zope object that can be accessed via the external method. > - why does temp_folder perform faster for this technique? 'temp_folder' folders are 'temporary' and only exist in memory (objects stored in/on 'temp_folders' are not written to the zodb), therefore are faster to access, but the downside is that when zope is shutdown all temp_folder content is lost. Jonathan _______________________________________________ Zope maillist - Zope(a)zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev ) ********************************************************************** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This footnote also confirms that this email message has been swept by MIMEsweeper for the presence of computer viruses. www.mimesweeper.com **********************************************************************

3 2

Generating links from a list
by John Poltorak 27 Jun '05

27 Jun '05

The other week someone provided me with this snippet of code for generating links from a list containing a description and a link:- <span tal:define="opts python:here.lib.parse_file(file=context.links,sepr=',',clone=1)"> <tal:block repeat="opt opts"> <li><a tal:content="python:opt[1]" tal:attributes="href python:opt[0]"></a></li> </tal:block> </span> This works fine, but now that I have used it in a template I'm finding that the link is being prepended with the location of the new object after selecting the original link. ie invoking the code above creates a link such as:- http://www.mysite.org/links/org-1 After selecting org-1 the new page displays as:- http://www.mysite.org/links/org-1/links/org-1 Is there something in the code above which generates the full URL? My links list consists of simple lines such as org-1,First link org-2,Second Link org-x,Another Link How do I prepend a hardcoded path to org-1 instead of what is getting generated? I would like to see the link for org-1 being generated as http://www.mysite.org/links/org-1 irrespective of the context. -- John

4 4

RE: ZopeProfiler issue (found root cause)
by Pascal Peregrina 27 Jun '05

27 Jun '05

I just finished reading xmlrpclib.py and ZopeProfiler code. Here is the root cause of the issue : In my code : getattr(ServerProxy(self.url),self.rpc_method_expr) returns an xmlrpclib._Method object Then ZopeProfiler calls ZopeProfiler.ZopeProfiler.getHLFuncId(self,fn,frame), which contains: gP= getattr(s,'getPhysicalPath',None) So this calls xmlrpclib._Method.__getattr__, which is: def __getattr__(self, name): return _Method(self.__send, "%s.%s" % (self.__name, name)) So this returns another xmlrpclib._Method object for a "getPhysicalPath" RPC method Because gP is not None, ZopeProfiler then does : p= gP() And this makes an RPC method call on the service, and of course raises an Exception ! So for my tests I hacked xmlrpclib._Method.__getattr__ to return None for 'getPhysicalPath' : def __getattr__(self, name): if name=='getPhysicalPath': return None return _Method(self.__send, "%s.%s" % (self.__name, name)) But a real fix will be needed on ZopeProfiler ! Thanks. Pascal -----Message d'origine----- De : Pascal Peregrina Envoyé : lundi 27 juin 2005 10:42 À : 'zope(a)zope.org' Objet : ZopeProfiler issue Hi, In a previous mail, I was asking if anyone had issues with ZopeProfiler and Zope 2.8. I have made many more tests and my issue is completely unrelated with Zope 2.8 (I got the same issue with Zope 2.7.6) The issue has to deal with an XML-RPC call to a java service (using the standard xmlrpclib module). The code is (method of a class of my own): def query(self): from xmlrpclib import ServerProxy, loads, ProtocolError try: if self.protocol=='HTTP GET': self.result=loads(urlopen(self.url).read())[0][0] elif self.protocol=='XMLRPC': self.result=getattr(ServerProxy(self.url),self.rpc_method_expr)(*self.params ) except ProtocolError: self.result=None self.zeroconf_exception=1 self.log_exception() except SocketError: self.result=None self.zeroconf_exception=1 self.log_exception() except IOError: self.result=None self.zeroconf_exception=1 self.log_exception() except: self.result=None self.log_exception() This works fine with disabled profiler. However, when I enable the profiler, I get this error : Fault: <Fault 0: 'java.lang.Exception: RPC handler object "cat.getProducts" not found and no default handler registered\n\tat org.apache.xmlrpc.SelfDocumentingHandlerMapping.getHandler(Ljava.lang.String ;)Ljava.lang.Object;(Unknown Source)\n\tat org.apache.xmlrpc.XmlRpcWorker.execute(Ljava.io.InputStream;Lorg.apache.xmlr pc.XmlRpcContext;)[B(XmlRpcWorker.java:183)\n\tat org.apache.xmlrpc.DocXmlRpcServer.execute(Ljava.io.InputStream;Lorg.apache.x mlrpc.XmlRpcContext;)[B(Unknown Source)\n\tat org.apache.xmlrpc.DocXmlRpcServer.execute(Ljava.io.InputStream;Ljava.lang.St ring;Ljava.lang.String;)[B(Unknown Source)\n\tat org.apache.xmlrpc.DocXmlRpcWebServer$Connection.run()V(Unknown Source)\n\tat org.apache.xmlrpc.DocXmlRpcWebServer$Runner.run()V(Unknown Source)\n\tat java.lang.Thread.run()V(Optimized Method)\n\tat java.lang.Thread.startThreadFromVM(Ljava.lang.Thread;)V(Optimized Method)\n'> I can reproduce that error if I omit (*self.params) on that line : self.result=getattr(ServerProxy(self.url),self.rpc_method_expr)(*self.params ) But when I add some logging, self.params looks fine. Changing that line into : self.result=apply(getattr(ServerProxy(self.url),self.rpc_method_expr),self.p arams) Gives the same error. I also tried hardcoding the arguments, and I still get the same issue ! I don't know what to do, I really need to profile my Zope instance. So any suggestion would be highly appreciated... Thanks. Pascal ********************************************************************** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This footnote also confirms that this email message has been swept by MIMEsweeper for the presence of computer viruses. www.mimesweeper.com **********************************************************************

2 1

ZMySQLDB problems
by Dennis Allison 27 Jun '05

27 Jun '05

I am seeing occasional errors like those below. Any have any idea what my problem here is? Zope 2.7.6 MySQL-server-4.0.20-0 MySQLDB aka MySQL-python-1.2.tc3 ZMySQL 2.0.9 Python 2.4.1 Typically the errors occur at initial login when the database is consulted to populate various session variables, etc. The my.cnf file is, in part: # change timeouts to close rather than wait # interactive == 1 hour, programs == 5 mins set-variable=interactive_timeout=3600 set-variable=wait_timeout=300 # uncomment to not log connection problems #set-variable=log-warnings=off ------------------------------------------------------------------------ 2005-06-26T23:11:06 ERROR(200) ZMySQLDA exception during _begin Traceback (most recent call last): File "/opt/zope/zproducts/standard/ZMySQLDA/db.py", line 349, in _begin self.db.ping() OperationalError: (2013, 'Lost connection to MySQL server during query') ------ 2005-06-26T23:11:06 PANIC(300) ZODB A storage error occurred in the last phase of a two-phase commit. This shouldn't happen. The application will not be allowed to commit until the site/storage is reset by a restart. Traceback (most recent call last): File "/usr/local/src/zope/Zope2.7/lib/python/ZODB/Transaction.py", line 377, in _finish_many jar.tpc_finish(self) File "/usr/local/src/zope/Zope2.7/lib/python/Shared/DC/ZRDB/TM.py", line 59, in tpc_finish try: self._finish() File "/opt/zope/zproducts/standard/ZMySQLDA/db.py", line 376, in _finish self._tlock.release() error: release unlocked lock ------ 2005-06-26T23:11:06 ERROR(200) ZODB A storage error occured during object abort. This shouldn't happen. Traceback (most recent call last): File "/usr/local/src/zope/Zope2.7/lib/python/ZODB/Transaction.py", line 412, in _commit_error j.tpc_abort(self) # This should never fail File "/usr/local/src/zope/Zope2.7/lib/python/Shared/DC/ZRDB/TM.py", line 63, in abort try: self._abort() File "/opt/zope/zproducts/standard/ZMySQLDA/db.py", line 389, in _abort self._tlock.release() error: release unlocked lock ------ 2005-06-26T23:11:06 ERROR(200) SiteError http://dev.agilemind.com/logged_in Traceback (most recent call last): File "/usr/local/src/zope/Zope2.7/lib/python/ZPublisher/Publish.py", line 107, in publish transactions_manager.commit() File "/usr/local/src/zope/Zope2.7/lib/python/Zope/App/startup.py", line 222, in commit get_transaction().commit() File "/usr/local/src/zope/Zope2.7/lib/python/ZODB/Transaction.py", line 260, in commit self._finish_many(jars) File "/usr/local/src/zope/Zope2.7/lib/python/ZODB/Transaction.py", line 377, in _finish_many jar.tpc_finish(self) File "/usr/local/src/zope/Zope2.7/lib/python/Shared/DC/ZRDB/TM.py", line 59, in tpc_finish try: self._finish() File "/opt/zope/zproducts/standard/ZMySQLDA/db.py", line 376, in _finish self._tlock.release() error: release unlocked lock ------ -- Dennis Allison * Computer Systems Laboratory * Gates 227 * Stanford University * Stanford CA 94305 * (650) 723-9213 * (650) 723-0033 fax * allison(a)shasta.stanford.edu * allison(a)sumeru.stanford.edu

2 1