- Zope - Zope lists

Finding a phone number in a python script
by Schmidt, Allen J. 24 Oct '02

24 Oct '02

I have a block of text that contains a phone number in the format of 888/123-4567 and I need to identify that sequence when it occurs and somehow extract it, and return it to Zope without the slash or the dash. Without regex in Python scripts, is there any way to do this? Thanks -Allen "Long live DTML!" (just starting learning Python) -----Original Message----- From: zope-admin(a)zope.org [mailto:zope-admin@zope.org]On Behalf Of Andreas Tille Sent: Thursday, October 24, 2002 6:52 AM To: Zope user list Subject: [Zope] Re: Exsternal method quote On Wed, 23 Oct 2002, Dieter Maurer wrote: > Projekt01, Roger Ineichen writes: > > What can I do if I whould return html code frome a external method? > > It always quote the return string > It seems that you are calling your external method from ZPT. > > In this case, you must use "structure" in from of your call. Is there any equivalent for this for Python Scripts? For certain reasons I use a script which returns a complete HTML-page. This Script calls another Script which parses some parameters and returns the contents of a file object of the ZODB. I plan to convert these files to structured text for easier user handling but currently this file contains HTML. I observed that also in a python script all HTML is quoted. Any hint how to prevent that? Kind regards Andreas. _______________________________________________ Zope maillist - Zope(a)zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )

3 2

CMF: add zwiki page/web TALESError
by Florian Konnertz 24 Oct '02

24 Oct '02

Hi all, please help me with this strange error: I want to add a ZWikiWeb or -page while logged in to CMF in the root folder. TALESError Sorry, a site error occurred. Traceback (innermost last): File /usr/local/Zope-2.5.0-src/lib/python/ZPublisher/Publish.py, line 150, in publish_module File /usr/local/Zope-2.5.0-src/lib/python/ZPublisher/Publish.py, line 114, in publish File /usr/local/Zope-2.5.0-src/lib/python/Zope/__init__.py, line 158, in zpublisher_exception_hook (Object: test) File /usr/local/Zope-2.5.0-src/lib/python/ZPublisher/Publish.py, line 98, in publish File /usr/local/Zope-2.5.0-src/lib/python/ZPublisher/mapply.py, line 88, in mapply (Object: FrontPage) File /usr/local/Zope-2.5.0-src/lib/python/ZPublisher/Publish.py, line 39, in call_object (Object: FrontPage) File /usr/local/Zope-2.5.0-src/lib/python/Products/ZWiki/ZWikiPage.py, line 198, in __call__ (Object: FrontPage) File /usr/local/Zope-2.5.0-src/lib/python/Products/ZWiki/ZWikiPage.py, line 210, in _render (Object: FrontPage) File /usr/local/Zope-2.5.0-src/lib/python/Products/ZWiki/ZWikiPage.py, line 472, in render_stxprelinkhtml (Object: FrontPage) File /usr/local/Zope-2.5.0-src/lib/python/Products/ZWiki/ZWikiPage.py, line 290, in addStandardLayoutTo (Object: FrontPage) File /usr/local/Zope-2.5.0-src/lib/python/Shared/DC/Scripts/Bindings.py, line 252, in __call__ (Object: wikipage) File /usr/local/Zope-2.5.0-src/lib/python/Shared/DC/Scripts/Bindings.py, line 283, in _bindAndExec (Object: wikipage) File /usr/local/Zope-2.5.0-src/lib/python/Products/PageTemplates/PageTemplateFile.py, line 94, in _exec (Object: wikipage) File /usr/local/Zope-2.5.0-src/lib/python/Products/PageTemplates/PageTemplate.py, line 86, in pt_render (Object: wikipage) (Info: {'container': <CMFWikiFolder instance at 9c4e888>, 'here': <ZWikiPage 'FrontPage' at 0x95ea730>, 'modules': <Products.PageTemplates.ZRPythonExpr._SecureModuleImporter instance at 0x864d0bc>, 'nothing': None, 'options': {'args': (), 'body': '<h3>Welcome to Zwiki. (... large html stuff .,,) align="left"><th>GATEWAY_INTERFACE</th><td>'CGI/1.1'</td></tr><tr valign="top" align="left"><th>HTTP_USER_AGENT</th><td>'Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2a) Gecko/20020910'</td></tr><tr valign="top" align="left"><th>HTTP_ACCEPT_CHARSET</th><td>'ISO-8859-1, utf-8;q=0.66, *;q=0.66'</td></tr></table>, 'root': <Application instance at 9277f80>, 'template': <MyPageTemplateFile instance at 896c9e0>, 'traverse_subpath': [], 'user': florian}) File /usr/local/Zope-2.5.0-src/lib/python/TAL/TALInterpreter.py, line 158, in __call__ File /usr/local/Zope-2.5.0-src/lib/python/TAL/TALInterpreter.py, line 191, in interpret File /usr/local/Zope-2.5.0-src/lib/python/TAL/TALInterpreter.py, line 491, in do_condition File /usr/local/Zope-2.5.0-src/lib/python/TAL/TALInterpreter.py, line 191, in interpret File /usr/local/Zope-2.5.0-src/lib/python/TAL/TALInterpreter.py, line 491, in do_condition File /usr/local/Zope-2.5.0-src/lib/python/TAL/TALInterpreter.py, line 191, in interpret File /usr/local/Zope-2.5.0-src/lib/python/TAL/TALInterpreter.py, line 402, in do_setLocal_tal File /usr/local/Zope-2.5.0-src/lib/python/Products/PageTemplates/TALES.py, line 247, in evaluate File /usr/local/Zope-2.5.0-src/lib/python/Products/PageTemplates/ZRPythonExpr.py, line 49, in __call__ (Info: split(container.AnnoyingQuote.raw,'\n')[-1]) File Python expression "split(container.AnnoyingQuote.raw,'\n')[-1]", line 2, in f TALESError: Sorry, an error occurred I cannot figure out what's wrong with Annoyiung quote or why there's a complete wiki page as an argument. Thanks in advance, Florian -- Florian Konnertz ---------------- http://www.openspirit.de consciousness research and wisdom traditions Collaboration space about these topics: http://openspirit.homelinux.net/os_portal/noowiki/FrontPage http://www.florian-konnertz.de homepage, my linux howtos http://www.openmovie.org movie and mp3 -player projects Have a nice day!

2 1

about Zope 2.6.0 stability
by cyrille 24 Oct '02

24 Oct '02

Hello, has anyone get some problem with Zope 2.6.0 stability ?? I got some strange random errors, like - error 5 input/ouput ... - files not found, then they came back after a zope restart ... many strange things, that they are repaired after a restart. Perhaps some incompatible with products ? I'm just using : - TransparentFolder - HTML widgets - a simple Product I've developed with Zope 2.4.1 Have you got a idea, a tips for tracking ? thanx for reading ;o) Cyrille

4 4

VirtualHostMonster and "unpack list of wrong size"
by Jo Meder 24 Oct '02

24 Oct '02

Hi all. After installing Zope 2.6final (which was rather a rather smooth transition from 2.5.1, congrats to all involved!) we found that our current setup exposed a very annoying behaviour. We have Apache doing the virtual host dance in front of Squid in accelerator mode to keep the system load low in front of Zope. Apache is intrumented with the usual Rewrite-Rule a la RewriteRule /(.*) http://localhost:1234/VirtualHostBase/http/%{HTTP_HOST}:80/cms_root/some_na… [L,P] Now there seem to be cases (we tracked most of them to usage of wget as a user agent) where VirtualHostMonster tries to decode "www.hostname.tld:80:80". The error occurs when VHM tries to execute host, port = host.split(':') Granted the original request is invalid and should at least generate a warning I'd suggest replacing the cited line by hostparts = host.split(':') host = hostparts[0] port = hostparts[1] This is not a bugfix since the hostname/port combination is obviously invalid, but it does add reasonable behaviour along the lines of "be liberal in what you accept and be conservative in what you send", which was one of the first lines I memorized when I started learning about protocols. Jo. -- Internetmanufaktur Jo Meder ---------------------- Berlin, Germany http://www.meder.de/ ------------------- fon: ++49-30-417 17 63 33 Kollwitzstr. 75 ------------------------ fax: ++49-30-417 17 63 45 10435 Berlin --------------------------- mob: ++49-170- 2 98 89 97 Public GnuPG-Key ---------- http://www.meder.de/keys/jo-pubkey.txt

3 4

RE: [Zope] Problems with restarts, memory usage, DB connections, FastCGI ?? Help!
by Jean-Francois.Doyon＠CCRS.NRCan.gc.ca 24 Oct '02

24 Oct '02

Charlie, Thanks for the insights, this should proove useful. About the momory, to be honest, I'm not convinced that's it. Yesterday for instance, Zope showed that behavior TWICE in one day, the first time it recovered itself, the second, I restarted. But, throughtout all this, there was PLENTY of swap available (My swap space is 2GB). I've NEVER seen the swap usage go beyond ~150MB actually. >From what you're saying, I think this issue of one thread per request might be the problem. I'm going to start by tackling this. It's the easiest and cheapest way for now. The issue of long requests (People adding data/content) mixed with the heavy load of the server (i.e. requests per second), and it is forseeable that this would happen. The issue of the large images is allways in my mind, but since that only happens occasionally, and in batches (It was going on this week), I'm willing to risk it for the increased convenience. While on the topic, I'm just curious as to why the processes/threads are structured as such: |-python2.1,11334) /usr/local/Zope-2.5.0/z2.py -F /tmp/fcgi/zope.soc -w - -p - -f - -D | `-python2.1,11337) /usr/local/Zope-2.5.0/z2.py -F /tmp/fcgi/zope.soc -w - -p - -f - -D | `-python2.1,11353) /usr/local/Zope-2.5.0/z2.py -F /tmp/fcgi/zope.soc -w - -p - -f - -D | |-python2.1,11354) /usr/local/Zope-2.5.0/z2.py -F /tmp/fcgi/zope.soc -w - -p - -f - -D | |-python2.1,11355) /usr/local/Zope-2.5.0/z2.py -F /tmp/fcgi/zope.soc -w - -p - -f - -D | |-python2.1,11356) /usr/local/Zope-2.5.0/z2.py -F /tmp/fcgi/zope.soc -w - -p - -f - -D | `-python2.1,11357) /usr/local/Zope-2.5.0/z2.py -F /tmp/fcgi/zope.soc -w - -p - -f - -D One talks to one talks to one talks to four ... Also, if I'm seeing it in PS, is it really a thread ? Or a process ? ps -m isn't implemented on unix, therefore can't show threads, so what am I seeing ??? Thanks for the help! J.F. -----Original Message----- From: Charlie Reiman [mailto:creiman@kefta.com] Sent: Thursday, October 24, 2002 12:30 PM To: Jean-Francois.Doyon(a)CCRS.NRCan.gc.ca; zope(a)zope.org Subject: RE: [Zope] Problems with restarts, memory usage, DB connections, FastCGI ?? Help! > So far I've been unable to track down WHY. Uhh.... > One thing that also happened just once was that the entire server ended up > running out of memory! Sounds like you tracked it down just fine. You are clearly exhasting your physical memory, the system is swapping like crazy, then it may eventually slog through the piggie bits to resume normal operation. You need more more memory and more threads. There are real limits as to what any system can do reasonably. It sounds like just bumping up the number of DB connections won't do anything for you. Arguably, the right thing for you to do is _decrease_ the number of available connections until you get more hardware (assuming the DB connections are used exclusively to upload files). Your system clearly can't maintain the load you are asking it to handle. It would be better to deny upload service to some folks than let the entire system collapse. Look into buying more memory and going with ZEO to split up the load. Read the man page for ps (assuming you're on unix) and top so you can track the amount of memory getting sucked down. Consider an emergency stop-gap solution where only one user may upload a file at a time. Increasing the number of theads (but not connections) may help. Some background here on why this is so painful: Zope starts with N theads (7, I think) for handling requests. A request is handled by a single thread and that thread is locked up until the request terminates. Python has no facility to preemptively stop thread and Zope never times out requests. As a result, it only takes a few long requests to completely lock up a zope server. If you consider that you could have 4 users uploading large files over slow links, you can see how you are in deep trouble even before considering the memory issue. So start by upping the number of threads (-t 15 maybe?) in your start script. On top of that, you are uploading large files which as you already noted zope doesn't handle really well. This topic comes up a lot here. Zope stores objects in memory. These file objects are going to be huge and rapidly consume all your physical memory. So in addition to starving your zope's thread count, you are now swapping like crazy. If I were you, I'd look into doing the file uploads out-of-band (ie, around zope) or buying lots and lots of RAM.

3 2

RE: [Zope] Finding a phone number in a python script
by Schmidt, Allen J. 24 Oct '02

24 Oct '02

I did wind up doing an ex meth. Only about 5 lines and it works well. What really are the risks if it will only be maybe two or three guys who will actually be using RE in py scripts? If there were many developers then I might see the issue. But if you know who is doing stuff on your server, where is the risk? Thanks for the info. -Allen -----Original Message----- From: zope-admin(a)zope.org [mailto:zope-admin@zope.org]On Behalf Of Dennis Allison Sent: Thursday, October 24, 2002 12:28 PM To: Schmidt, Allen J.; list_subscriber(a)neurobs.com Cc: zope(a)zope.org Subject: Re: [Zope] Finding a phone number in a python script Faced with similar problems, I enabled regular expression search in Python Scripts (see the README in the product for instructions). IMHO a risks/reward analysis for the re module easily justifies its inclusion. Andreas Tille wrote: Use an external method. Schmidt, Allen J. wrote: >I have a block of text that contains a phone number in the format of >888/123-4567 and I need to identify that sequence when it occurs and somehow >extract it, and return it to Zope without the slash or the dash. > >Without regex in Python scripts, is there any way to do this? > _______________________________________________ Zope maillist - Zope(a)zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )

1 0

Re: [Zope] Finding a phone number in a python script
by Dennis Allison 24 Oct '02

24 Oct '02

Faced with similar problems, I enabled regular expression search in Python Scripts (see the README in the product for instructions). IMHO a risks/reward analysis for the re module easily justifies its inclusion. Andreas Tille wrote: Use an external method. Schmidt, Allen J. wrote: >I have a block of text that contains a phone number in the format of >888/123-4567 and I need to identify that sequence when it occurs and somehow >extract it, and return it to Zope without the slash or the dash. > >Without regex in Python scripts, is there any way to do this? >

1 0

Zope 2.6 external PRODUCTS_PATH don't work
by Projekt01, Roger Ineichen 24 Oct '02

24 Oct '02

Hello With Zope 2.6 I use a external PRODUCTS_PATH folder. example: set PRODUCTS_PATH=c:\projects\zopeProducts;c:\webapps\zope260\lib\python\Pro ducts; This example works in Zope 2.5.1 whats changed in 2.6 The products in this folder don't find import classes in the real python/lib/Products folder. Mit freundlichen Grüssen Roger Ineichen ___________________________ Projekt01 GmbH www.projekt01.ch Langackerstrasse 8 6330 Cham phone +41 (0)41 781 01 78 mobile +41 (0)79 340 52 32 fax +41 (0)41 781 00 78 email r.ineichen(a)projekt01.ch ___________________________ END OF MESSAGE

3 2

import pyexpat not known in zope 2.6?
by Projekt01, Roger Ineichen 24 Oct '02

24 Oct '02

Hello together I whould like import pyexpat a xml parser in a class. But pyexpat isn't known in zope. I use WinXP, Zope 2.6. Mit freundlichen Grüssen Roger Ineichen ___________________________ Projekt01 GmbH www.projekt01.ch Langackerstrasse 8 6330 Cham phone +41 (0)41 781 01 78 mobile +41 (0)79 340 52 32 fax +41 (0)41 781 00 78 email r.ineichen(a)projekt01.ch ___________________________ END OF MESSAGE

1 0

Re: [Zope] Idea of Caching DTML Methods in Zope
by Elena Schulz 24 Oct '02

24 Oct '02

Just an idea of a newbie, if there is no other caching-possibility maybe creating and using a special folder-object as a subobject of the standard folder-object with a property of the wanted info, i.e. PARENTS[3:], which changes whenever the folder is created and copied elsewhere in the hierachy is a solution. Maybe it can be achieved with the products "AbacadabraObject" and "PropertyFolder" ... To my knowledge it is possible to add a script (i.e. localroot.py) as a zope-property, at least for the property-types "multiple selection" and "selection". HTH Elena

1 0