February 2003 - Zope-Dev

How can I tell what a Zope Process is doing?
by Chris Withers 19 Feb '03

19 Feb '03

Hi, I have a Zope instance whose memory usage is ballooning every so often (to 800Mb or so :-S) Now, I can see using top that one Zope process is using a lot of CPU and I'm guessing it's doing some silly iteration that's dragging huge numbers of objects into memory. The problem is that I'm having a pretty hard time figuring out what this process is doing and how I can prevent it. So, does anyone have any idea how I can find out? As a related question, does the line get written to Z2.log before or after serving the request has been completed? Hmmm, just had another thought. Does ChrisM's 'big m' logging show how much memory was used to serve a particular request? cheers, Chris

4 6

Re: [ZODB-Dev] Zope 2.5.1 with ZEO 2.0.2 (fwd)
by Brian R Brinegar 19 Feb '03

19 Feb '03

Okay, I went back and did some more intrusive poking. First I raised an exception in ZServer/PubCore/ZRendevous.py before it creates a thread. That works (I get an internal server error and it's logged). Next I moved the exception to the constructor for ZServerPublisher (called on the next line) and I get nothing! it hangs. If I do this on a Zope 2.5.1 with ZEO 1.0 I will get an error sent to the browser. Next I changed the contstructor for ZServerPublisher to append to a file in /tmp/ this worked on the ZEO 1.0 but did not work on ZEO 2.0.2 setup. It seems that the threads are there but that they are not running. It is creating the threads, as I can see 7 python processes after I make a request. It's like thread.start_new_thread is creating the thread, but never calling ZServerPublisher. Any idea what would cause that? We're using python 2.1.3 source from python.org. Built like this (I think Andy or Chris correct me if I'm wrong) configure --with-gcc make make install Thanks for taking the time to help us out, -Brian Brinegar ECN Web System Developer Purdue University West Lafayette, IN On Tue, 18 Feb 2003, Guido van Rossum wrote: > > Here it is: > > > > import ZServer > > import ZEO.ClientStorage > > > > Storage = ZEO.ClientStorage.ClientStorage(('192.168.1.51',15900), > > var='/data/www/Zope.251.ZEO2/Zope/var', cache_size=200000000) > > > > Thanks, > > -Brian > > Alas, no clues there either. > > --Guido van Rossum (home page: http://www.python.org/~guido/) >

1 0

Transcience getId() KeyError
by Alan Runyan 18 Feb '03

18 Feb '03

Using Zope2.6.0 final on FreeBSD; Python 2.1.3 this is at iMeme. Question: I thought I read Tim squashed most (all?) of the known bugs in BTree's in 2.6. Is this true? Has anyone seen this? in a Product i'm using/wrote... we try to get the SESSION.getId() and get a KeyError. Here is the traceback. I would appreciate any feedback. Many thanks. # gc the stale buckets at the "beginning" of _data ("garbage collect") # iterate over the keys in data that have no minimum value and # a maximum value of delete_end (note: ordered set) # XXX- fixme. range search doesn't always work (btrees bug) I believe it is the line after this that is throwing the exception for k in list(data.keys(None, delete_end)): here was the exception: Site Error An error was encountered while publishing this resource. KeyError Sorry, a site error occurred. Traceback (innermost last): * Module ZPublisher.Publish, line 150, in publish_module * Module ZPublisher.Publish, line 114, in publish * Module Zope, line 171, in zpublisher_exception_hook * Module ZPublisher.Publish, line 98, in publish * Module ZPublisher.mapply, line 88, in mapply * Module ZPublisher.Publish, line 39, in call_object * Module Shared.DC.Scripts.Bindings, line 252, in __call__ * Module Shared.DC.Scripts.Bindings, line 283, in _bindAndExec * Module Products.PageTemplates.ZopePageTemplate, line 228, in _exec * Module Products.PageTemplates.PageTemplate, line 95, in pt_render <ZopePageTemplate at /cmf/public_website/index_html> * Module TAL.TALInterpreter, line 186, in __call__ * Module TAL.TALInterpreter, line 230, in interpret * Module TAL.TALInterpreter, line 689, in do_useMacro * Module TAL.TALInterpreter, line 230, in interpret * Module TAL.TALInterpreter, line 459, in do_setLocal_tal * Module Products.PageTemplates.TALES, line 217, in evaluate URL: /cmf/main_template Line 104, Column 4 Expression: standard:'here/portal_commerce/getShoppingCartFor' Names: {'container': <PloneFolder instance at 9372b00>, 'default': <Products.PageTemplates.TALES.Default instance at 0x88bf9ec>, 'here': <PloneFolder instance at 9372b00>, 'loop': <SafeMapping instance at 905c0d0>, 'modules': <Products.PageTemplates.ZRPythonExpr._SecureModuleImporter instance at 0x88b392c>, 'nothing': None, 'options': {'args': ()}, 'repeat': <SafeMapping instance at 905c0d0>, 'request': <HTTPRequest, URL=http://www.dstoys.com/index_html>, 'root': <Application instance at 903d080>, 'template': <ZopePageTemplate at /cmf/public_website/index_html>, 'traverse_subpath': [], 'user': Anonymous User} * Module Products.PageTemplates.Expressions, line 206, in __call__ * Module Products.PageTemplates.Expressions, line 201, in _eval * Module Products.PageTemplates.Expressions, line 108, in render * Module Products.CMFCommerce.CommerceTool, line 260, in getShoppingCartFor * Module Products.CMFCommerce.ShoppingCartManagement, line 113, in getShoppingCartFor * Module ZPublisher.HTTPRequest, line 1189, in __getattr__ * Module ZPublisher.HTTPRequest, line 1149, in get * Module Products.Sessions.SessionDataManager, line 93, in getSessionData * Module Products.Sessions.SessionDataManager, line 180, in _getSessionDataObject * Module Products.Transience.Transience, line 175, in new_or_existing * Module Products.Transience.Transience, line 786, in get * Module Products.Transience.Transience, line 599, in _getCurrentBucket * Module Products.Transience.Transience, line 688, in _housekeep KeyError: 1045356900 (Also, an error occurred while attempting to render the standard error message.)

2 1

RE: [Zope-dev] zope connector
by sean.upton＠uniontrib.com 18 Feb '03

18 Feb '03

Use ZEO and DBTab and a shared mounted object database that both Zope instances have access to. Put any objects that need to be accessed by both Zope servers in that common storage mounted at some folder-level in your zope setup. Sean -----Original Message----- From: Tena Sakai [mailto:tena.sakai.b@bayer.com] Sent: Tuesday, February 18, 2003 1:56 PM To: zope-dev(a)zope.org Subject: [Zope-dev] zope connector Folks, I am interested in accessing resorcces from two or more zope servers. For example, hahaha! <dtml-var name=funny> hohoho! The code snippet above will, when rendered, yield: hahaha! hehehe! hohoho! provided that the entity funny ultamately returns hehehe! and accessible within the name space. But how could I do this if the object funny is on a different zope server? Ie., how can I connect two name spaces on different zope servers in some not-so-caotic fasion? Thanks in advance. Regards, Tena Sakai _______________________________________________ Zope-Dev maillist - Zope-Dev(a)zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )

1 0

zope connector
by Tena Sakai 18 Feb '03

18 Feb '03

Folks, I am interested in accessing resorcces from two or more zope servers. For example, hahaha! <dtml-var name=funny> hohoho! The code snippet above will, when rendered, yield: hahaha! hehehe! hohoho! provided that the entity funny ultamately returns hehehe! and accessible within the name space. But how could I do this if the object funny is on a different zope server? Ie., how can I connect two name spaces on different zope servers in some not-so-caotic fasion? Thanks in advance. Regards, Tena Sakai

1 0

passing browser Id value #2
by Mario Bianchi 18 Feb '03

18 Feb '03

Hi to all, this follows my previous having subject "passing browser Id value" to further explain what I'm looking for. I want to embed the browserId value in every link/button/clickable-item of the pages in my site as the very last action before sending the pages back to the client; put another way I want to parse the HTML code of the page that Zope has built in response to the current HTTP request, embed into the 'href' and 'form' tags some identifier of mine and send the modified page back to the client. The point is that the parsing and embedding are to be performed 'on exit' -so to say-, i.e. when Zope has already processed the web request and built an HTML page to be sent back. ------ To Dieter Maurer: Hi Dieter, does your extension to VHM meet these requirements? I'm afraid VHM is targeted to solving the problem of URL rewriting BEFORE letting Zope handle (publish) it, while I need some sort of parsing/rewriting 'on exit'. Thanks, cheers, Mario. _________________________________________________________________ Help STOP SPAM with the new MSN 8 and get 2 months FREE* http://join.msn.com/?page=features/junkmail

2 1

ZEO 2 and Zope 2.5.1
by Brian R Brinegar 17 Feb '03

17 Feb '03

We've been using ZEO 1 with Zope 2.5.1 but some issues exist with ZEO 1, so we decided to move to ZEO 2. Everything is installed installs and starts normally. The server logs show a connection. However any HTTP requests sent to the ZEO client hang. I did a bit of poking around and it appears that the load method of ClientStorage is not called when a request is recieved. Can anyone point me in the right direction? Thanks, -Brian Brinegar ECN Web Systems Developer Purdue University West Lafayette, IN

2 2

zope
by Gilles Lenfant 16 Feb '03

16 Feb '03

Hi, I'm pretty familiar with the usual unittest package I use successfully with my non-Zope python projects, but I haven't get enough enlightenment for playing unit tests on my Zope products. * The tips from the Zope developer guide don't work (did I miss something ?) * I did'nt understand how to use testrunner.py and framework.py * I tried desperately to use the ZopeTestCase with no success Is there somewhere a "hello world" product using a ZopeTestCase test suite to help me to get the enlightenment ? Thanks in advance. --Gilles

2 1

Re: [Zope-dev] Re: [Zope] PCGI?
by Romain Slootmaekers 15 Feb '03

15 Feb '03

here's an edited repost from an answer I got from this mailing list. it has helped me with zope+apache (+ ssl) and is a good start for the documentation upgrade, (although I personally use the apache proxypass directives) -- original help from Leonardo Rochael Almeida <leo(a)hiper.com.br> -- Here is how you'd do it with VirtualHostMonster and apache: 1. add a single one virtual host monster to your Zope root. Give it any id you want. You can be creative, 'cause it won't matter :-) 2. In apache, change your configuration to read like below. To understand why the ProxyPass urls read like that, look at the VirtualHostMonster object or consult the SiteAccess2 documentation here: http://www.zope.org/Members/4am/SiteAccess2/info ### Apache ### # better to use the IP address instead of the name here, # to avoid dns lookups on apache initialization NameVirtualHost www.greatsite.com # better to use the IP address here too, for the same reason <VirtualHost www.greatsite.com> # here you put the server name instead of the address. # it won't result in a dns lookup. ServerName www.greatsite.com # secure /private RedirectMatch permanent ^/private https://www.greatsite.com/private$1 # the :80 below is NECESSARY. Don't ommit it ProxyPass / http://127.0.0.1:8080/VirtualHostBase/http/www.greatsite.com:80/greatsite/V… </VirtualHost> NameVirtualHost www.greatsite.com:443 <VirtualHost www.greatsite.com:443> ServerName www.greatsite.com # note the protocol specification after VirtualHostBase. As above, # the port specification is not optional ProxyPass / http://127.0.0.1:8080/VirtuaHostBase/https/www.greatsite.com:443/greatsite/… SSLEngine on SSLCertificateFile /etc/httpd/ssl.crt/server.crt SSLCertificateKeyFile /etc/httpd/ssl.key/server.key </VirtualHost> EOF I haven't tested the configuration above. I'd use RewriteRules instead of RedirectMatch and ProxyPass, but just because that's what I'm used to doing. Notice that ProxyPassReverse directives aren't needed, because the VirtualHostMonster, when presented with the above URLs, effectively convinces Zope that it's running in the above mentioned ports and protocols. No SiteRoot objects are needed. ----------------------- end of original help --------------- have fun, Sloot. -- "Science can amuse and fascinate us all, but it is engineering that changes the world." Isaac Asimov

5 4

PyCon DC 2003 Sprints
by Jeremy Hylton 14 Feb '03

14 Feb '03

PyCon DC 2003 Sprints: Call for Participation http://www.python.org/cgi-bin/moinmoin/SprintPlan We are seeking coaches and participants for the sprint sessions preceding PyCon DC. A sprint is a two or three day focused development session, in which developers pair in a room and focus on building a particular subsystem. A sprint is organized with a coach leading the session. The coach sets the agenda, tracks activities, and keeps the development moving. The developers work in pairs using extreme programming's pair programming approach. The sprint approach works best when the first few hours are spent getting oriented -- presenting a tutorial for the development material, laying out the stories to tackle for the day, getting everyone a CVS checkout to work with. We need coaches to develop a sprint topic, lead the development effort, and help with the logistics of matching participants with sessions. In a successful sprint, the coach usually spends a lot of time helping others and little or no time doing development. What makes a good sprint topic? It must be possible to make real progress with just a day's effort. It would be good to make small enhancements to existing projects, finish off ongoing development on some project, or work on a new library that you'd like to contribute to the standard library. It probably doesn't make sense to sprint on a project that is brand new; you'd be better off sitting in a coffee shop talking. We're looking for topics that would hold the interest of 6-12 developers for a day or two. If you would like to coach a sprint, please send mail to jeremy(a)alum.mit.edu. We would like to finalize the sprint topics next week, so get in touch as soon as possible. We already have two sprint sessions planned. Chris Armstrong will be coaching a Twisted sprint, and Jim Fulton will be coaching a Zope sprint. People who want to participate in the sprints, but not coach, should make arrangements with a specific coach. The coaches will help me allocate the space fairly among the different topics. Space may be limited, so we would prefer to have people make plans to attend a specific sprint in advance. If you want to come, but don't know what session to attend at your name to the Wiki so that we can match you up with a sprint. The cost for attending the sprint sessions will be $25/day. That amount will cover the cost of the sprint rooms and electrical and network infrastructure. We don't expect to provide meals, but there is a cafeteria in the building. Jeremy Hylton PyConDC sprint chair

1 0