August 2004 - Zope - Zope lists

preseve status of dtml-tree
by Gál László 31 Aug '04

31 Aug '04

Hi! I have a single page (should be no frames) with a dtml-tree. There are plenty of links on this page to itself, with different arguments. My question is how to preserve the status of dtml-tree, because now it is lost after invoking the page again by such a link. I know that dtml-tree is deprecated, but it has the ability to build itself from a query, and I have not found this in ZopeTree, that's the only reason I'm still using it. tnx Lac

2 1

duplicate or 'echoing' REQUEST?
by Jim Abramson 31 Aug '04

31 Aug '04

Hi there, Running 2.6.0 we have a curious intermittent syndrome involving what we _suspect_ to be multiple identical incoming POST requests. To be honest, this could be any number of things happening...however the most obvious one (user clicking submit twice on the same form) has been eliminated, after quite a bit of testing on various browsers (clicking submit as many times as possible before the current html page/form "leaves" does not reproduce the issue). The problem ends up manifesting with unique-key violations from the external rdbms, where it's trying to update or insert some row twice in succession. Or, more annoyingly, quiet double-insertion of some submitted data. Before we turn zope upside down and shake the hell out of it, has anyone out there experienced a similar situation, or know of a programming or configuration error that might lead one to expect this behavior? Thanks for any advice, Jim

3 2

Throwing exception using dtml-raise
by Andrey Shuvikov 31 Aug '04

31 Aug '04

Hi, Is it possible to throw an exception (not string) using dtml-raise? Both <dtml-raise Exception>Text</dtml-raise> and <dtml-raise type="Exception">Text</dtml-raise> behave like raise "Exception", "Text" rather than raise Exception("Text") which means I cannot catch this error in Python Script using "except Exception, ex:" Thanks, Andrey This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This message contains confidential information and is intended only for the individual named. If you are not the named addressee you should not disseminate, distribute or copy this e-mail.

2 1

dict
by Vahur Rebas 31 Aug '04

31 Aug '04

Hi, I was doing some dict modifing like testvar = {'test1':{'test2':'test2value'}} so, everything was nice until I hit my browsers refresh button as fast as I could and my little method which did some if not testvar.has_key('test1') wrote my default values to my testvar tried setting self._p_changed = 1 but after some time(usually sooner) my values disapear and after zope restart they even don't exist anymore :( Tried PersistentMapping, that also didn't help much :( any suggestions? Vahur

2 1

RE: [Zope] duplicate or 'echoing' REQUEST?
by Jim Abramson 31 Aug '04

31 Aug '04

Thanks. Well it's not actually good news. I use Oracle9i! If these are ZODB Conflict Errors, should I expect to see them in the event log? (My ORA-00001 errors are there but I see no conflict errors.) Lets say I moved all my db logic into external modules, hiding any references to database connections or result objects completely from the ZODB and any ZODB-based assets like DTML, PythonScript etc...would you expect this to solve the problem? Jim -----Original Message----- From: Chris McDonough [mailto:chrism@plope.com] Sent: Tuesday, August 31, 2004 4:57 PM To: Jim Abramson Cc: zope(a)zope.org Subject: Re: [Zope] duplicate or 'echoing' REQUEST? This is almost certainly due to a ZODB phenomenon known as a conflict error. You can probably google around for "zope conflict error" or "zodb conflict error" to get a sense of what these are, or read the "Sessions" chapter of the Zope Book for a short overview. The easiest way to prevent needing to think about it is to use an RDBMS with transaction support (I suspect you're using MySQL tables without InnoDB, right?). If you can't do that, and you can't live with the result of the conflict errors, you'll need to really dig into Zope guts to prevent duplicate insertions; this is not recommended. On Tue, 2004-08-31 at 16:35, Jim Abramson wrote: > Hi there, > > Running 2.6.0 we have a curious intermittent syndrome involving what > we _suspect_ to be multiple identical incoming POST requests. > > To be honest, this could be any number of things happening...however the > most obvious one (user clicking submit twice on the same form) has > been eliminated, after quite a bit of testing on various browsers > (clicking submit as many times as possible before the current html > page/form "leaves" does not reproduce the issue). > > The problem ends up manifesting with unique-key violations from the > external rdbms, where it's trying to update or insert some row twice > in succession. Or, more annoyingly, quiet double-insertion of some > submitted data. > > Before we turn zope upside down and shake the hell out of it, has > anyone out there experienced a similar situation, or know of a > programming or configuration error that might lead one to expect this > behavior? > > Thanks for any advice, > > Jim > > > > > ______________________________________________________________________ > _______________________________________________ > Zope maillist - Zope(a)zope.org > http://mail.zope.org/mailman/listinfo/zope > ** No cross posts or HTML encoding! ** > (Related lists - > http://mail.zope.org/mailman/listinfo/zope-announce > http://mail.zope.org/mailman/listinfo/zope-dev )

2 1

"./start -t 2" does not start 2 but 4 threads
by Jens Nachtigall 31 Aug '04

31 Aug '04

Hi all, I use Zope-2.6.2-linux2-x86 on RedHat-Linux7.2. When I want to start Zope with only 2 threads (I want to reduce the memory usage), 4 threads are started: $ pstree -a -c freifunk python) /home/www.freifunk.net/Zope-2.6.2-linux2-x86/z2.py -t 2 `-python) /home/www.freifunk.net/Zope-2.6.2-linux2-x86/z2.py -t 2 `-python) /home/www.freifunk.net/Zope-2.6.2-linux2-x86/z2.py -t 2 |-python) /home/www.freifunk.net/Zope-2.6.2-linux2-x86/z2.py -t 2 `-python) /home/www.freifunk.net/Zope-2.6.2-linux2-x86/z2.py -t 2 (Yes, that are 5 not 4 processes, but only the last 4 consume a lot of memory [about 64MB]): PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME COMMAND 16284 freifunk 9 0 66124 64M 2216 S 0.0 7.3 3:07 python 16290 freifunk 9 0 66124 64M 2216 S 0.0 7.3 0:00 python 16291 freifunk 9 0 66124 64M 2216 S 0.0 7.3 72:00 python 16292 freifunk 18 0 66124 64M 2216 S 2.9 7.3 82:45 python Do I start it with "-t 3" then 5 threads are started: $ pstree -a -c freifunk python) /home/www.freifunk.net/Zope-2.6.2-linux2-x86/z2.py -t 3 `-python) /home/www.freifunk.net/Zope-2.6.2-linux2-x86/z2.py -t 3 `-python) /home/www.freifunk.net/Zope-2.6.2-linux2-x86/z2.py -t 3 |-python) /home/www.freifunk.net/Zope-2.6.2-linux2-x86/z2.py -t 3 |-python) /home/www.freifunk.net/Zope-2.6.2-linux2-x86/z2.py -t 3 `-python) /home/www.freifunk.net/Zope-2.6.2-linux2-x86/z2.py -t 3 There always seem to be 2 more threads started then I want (4 instead of 2, 5 instead of 3). Is this normal behaviour or a bug? Best regards, Jens

2 1

PCNG 1.2.3 and cataloge query question
by Bryan Simmons 31 Aug '04

31 Aug '04

Hey, This isn't a bug or feature request, so I'm keeping it out of the collective tracker. I'm writing custom reports for an instance of PloneCollectorNG 1.2.3. I am stuck at a point, however. I want to show all issues created between two dates. So far, this is the query I have: <li tal:repeat="row python: here.pcng_catalog(created={'query' : [ date1 , date2 ], 'range' : 'minmax' }, sort_on='getId')"> date1 and date2 are defined as such in a tal:define="date1 python: context.String2DateTime('7/1/04');" For some reason this query returns nothing, though I know the data range is correct. I think that perhaps the format or datatype of the date1/date2 vars is wrong. I took a long look at Andreas' code for his date search and his is done as a subtraction of DateTime() - int(d_value) which suggests that the data value passed to a query must be in integer form. But I tried this via: date1 python: int('7/1/04') Python did not like that at all. Can anyone hint at an answer? -- Regards, Bryan Simmons -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Always code as if the guy who ends up maintaining your code will be a violent psychopath who knows where you live. -- Rick Osborne -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-

2 1

Problem with TemporaryFile?
by Marc Burgauer 31 Aug '04

31 Aug '04

Zope 2.4, Solaris 8 on Intel (Compaq), Python 2.1 We are getting increasing problems with a specific installation of Zope on a rather busy site. (Over 400,000 hits per day, over 90GB of monthly traffic to give an indication.) There are about 50 people editing the site, sometimes a lot of them at the same time, including uploading PDFs of several Megabytes. Even ore people will be downloading those PDFs. The error messages that Zope produces is usually: Error Type: OSError Error Value: [Errno 2] No such file or directory Traceback (innermost last): File /sw1/amanda/lib/python/ZPublisher/Publish.py, line 223, in publish_module File /sw1/amanda/lib/python/ZPublisher/Publish.py, line 187, in publish File /sw1/amanda/lib/python/Zope/__init__.py, line 226, in zpublisher_exception_hook (Object: ApplicationDefaultPermissions) File /sw1/amanda/lib/python/ZPublisher/Publish.py, line 136, in publish File /sw1/amanda/lib/python/ZPublisher/HTTPRequest.py, line 405, in processInputs File /sw1/packages/python/lib/python2.1/cgi.py, line 517, in __init__ File /sw1/packages/python/lib/python2.1/cgi.py, line 601, in read_multi File /sw1/packages/python/lib/python2.1/cgi.py, line 519, in __init__ File /sw1/packages/python/lib/python2.1/cgi.py, line 616, in read_single File /sw1/packages/python/lib/python2.1/cgi.py, line 636, in read_lines File /sw1/packages/python/lib/python2.1/cgi.py, line 723, in make_file File /sw1/amanda/lib/python/tempfile.py, line 154, in TemporaryFile OSError: (see above) At some time, the error reported is "too many files open". We have customised the start script: ulimit -n 1024 python /prod/zope/z2.py -X -a212.96.140.77 -w80 The "cure" for the problem at the moment requires to: - Stop the Server - Remove all Data.fs.* files (but not Data.fs itself, of course) [possibly removing the .tmp file would do?] - Restarting the Server Packing the DB does not help, neither does just restarting the server alone. Unless we remove the extra files, the problem persists. The cure lasts a few hours at the moment. There are q number of caches installed. Could they be the source of the problem? I have problems finding out how many files are opened by this instance of Zope. (There are other Zope instances running on the same machine.) In fact, I have not find a way to see how many files are open really. (I found how to do it on our testing server, which is BSD and on my Mac, but not for Solaris, which is the customer's choice of OS.) Does anybody know? Is this an issue of the server being stressed to its limits? The server stats (using "top" for example) indicate high load, but not very high. And if so, would using ZEO help? The server has 2 CPUs, but we deliberately did not compile the python to utilise both CPUs. (Operational reasons.) Is there somewhere a HOW-TO for using ZEO on 2-CPU box? Any suggestions how to solve this problem is very much appreciated. Cheers Marc

2 2

MySQL thread connection question
by aschmidt＠fredericksburg.com 31 Aug '04

31 Aug '04

Mornin, We use ZEO and two public clients on Linux along with Squid and POUND on one box. All this is attached to MySQL4 on the same box. For reasons unknown the clients will thread-hang for long periods and all the threads will fill up and make the client unreachable. POUND will still try to direct requests to the full client and so cause our 'www' to become unreachable. When this happens we manually pull the rug from the unresponsive client and restart it. Eveything is fine once again. However, in watching the threads in MySQL, there will be many sleeping threads that have lived for MUCH longer than any of the running zope clients. We are assuming that the zope client connections are established when the client comes up and are maintained whether used or not. When we kill the client those threads stay there and new connections are made to MySQL. As I write this I think its turning into more of a MySQL topic than zope but is there anything that can be done to kill off the old sleeping MySQL threads or have the zope client use the ones that are there already?? Sort of confusing but thought I would throw this out. Thanks Allen

9 38

Re: [Zope] __bobo_traverse__ (Cont.)
by Garito 31 Aug '04

31 Aug '04

Johan Carlsson wrote: > Garito wrote: > >> Hi >> In my last mail I ask you (thanks for your responses) about an error >> publishing the object in __bobo_traverse__ >> The solution passes by returning an object instead a string (I would >> like to return a string :( ) >> Then my __bobo_traverse__ is something like: >> >> def __bobo_traverse__(self, REQUEST, name): >> obj = getattr(self, name, None) >> if obj is not None: >> return obj >> else: >> return getattr(self, 'Result') >> >> But I need to process some information in bobo_traverse before >> returns Result >> If you change the line return getattr(self, 'Result') for return >> getattr(self, 'Result')('someresults') doesn't work >> For that I need to do something like: >> >> _Results = dict() # I put these declaration in my class >> >> def __bobo_traverse__(self, REQUEST, name): >> obj = getattr(self, name, None) >> if obj is not None: >> return obj >> else: >> self._Results[str(REQUEST.SESSION.id)] = self.MyResult() >> return getattr(self, 'Result') >> >> def MyResult(self): >> """MyResult""" >> return 'This is my test result' >> >> def GetResults(self, Session): >> """ GetResults""" >> return self._Results[str(Session)] >> >> Then I create a Python Script called Result like: >> return context.GetResults(context.REQUEST.SESSION.id) >> But all these code raise: >> >> Traceback (innermost last): >> Module ZPublisher.Publish, line 91, in publish >> Module ZPublisher.BaseRequest, line 302, in traverse >> Module Products.MyProducts.MyProduct, line 116, in __bobo_traverse__ >> TypeError: object does not support item assignment >> >> I can't undersand why can't I assign a dictionary. I can understand >> if I try to assign a number like dictionary key (but I convert the >> session id to a string) > > > Exactly what is self._Results when you're trying to assign it. > It sounds to me that it's not what you think it is. > Remember Python is a Dynamically Typed language :-) > I'd check that anyway. > > Second, from your example "return getattr(self, 'Result')" doesn't > make sense because Result is never set (as far as the exemple code goes). > > All this seems very complicated though, I think there can be a cleaner > solution (for instance returning a object that does the calculation: > > > def __bobo_traverse__(self, REQUEST, name): > obj = getattr(self, name, None) > if obj is not None: > return obj > else: > brain=CalculatingBrain(REQUEST.SESSION.id, or what ever > data is needed ) > return brain > > with: > > class CalculatingBrain(Implicit): > > security = ClassSecurityInfo() > security.declareObjectProtected(View) #Or what ever. > def __init__(self, session_id, or what ever): > pass or do stuff > > def MyProduct(self, REQUEST=None): > """You could even make this traversable if you'd like""" > return 'Result' > > > > Thanks again Johan for your response getattr(self, 'Result') is a python script inside my product (my product is a container) I can't undersant the complexity in these case Perhaps could be interesant to explain what I try to do before continue these conversation I try to process TraversalRequestNameStack (traverse_subpath) as user query Then I would like to generate the response and serve it to the user For example: user tye some thing like: http://myserver:myport/MyProduct/Value1 User wants Value1 in MyProduct Value1 is a processed value that returns: 'This is the result of precessing Value1' How could I do it? (Perhaps with these point of view we can understand ourselves better) My thoughts: Override __bobo_traverse__ to process TraversalRequestNameStack because traverse_subpath is not available in products Then return the results to be printed in the screen I assume these would be truly in fact easier :'( These explanation illuminate you? (I hope so!!!) THANKS AGAIN PD: Sorry for my english!

2 1