April 2005 - Zope - Zope lists

RE: [Zope] Memory management problems
by Pascal Peregrina 20 Apr '05

20 Apr '05

My useless comment: In such a real world scenario, anyone would put squid between Zope and the millions of users. :) Pascal -----Message d'origine----- De : zope-bounces(a)zope.org [mailto:zope-bounces@zope.org]De la part de Peter Millar Envoyé : mercredi 20 avril 2005 02:28 À : plone-users(a)lists.sourceforge.net; Zope Objet : [Zope] Memory management problems I have a serious memory problem. And would like to hear from anyone who has large image files being served up to a large number of simultaneous user base. I am running plone 2.0, zope 2.7.3, python 2.3.3, on windows 2003 server with 1.5 GB RAM. I have a 1MB image. I have created a little script to copy and paste this image. To do it 50 times takes 6 minutes and uses up 300 MB of RAM. If I then view the folder that contains all the images and start viewing the zpt that serves a single image it takes 40 seconds to a minute 20 and chews up approx 2-5MB. If I then get a few other machines to request the same image at the same time, it takes 20seconds for the first machine, 40 seconds for the next machine and 1 min for the next machine and another 20 MB of ram has been chewed up. Each time I go to serve a page my CPU usage jumps to 50% for the minute or so. After doing this over and over for a few minutes sees my machine has no RAM left. The only way to recover is to restart zope. My question after all of this is how in the world can anyone seriously use plone/zope in a real world scenario with potentially millions of users accessing a site viewing content if you have to restart your zope service every minute. I have spent the past two days looking at all sorts of cacheing ideas, session ideas etc. Is there some magic that I need to apply for this to work like any number of web image viewers. Or is it a case of throwing 100GB of Ram at the machine. ____________________________________________ Peter Millar _______________________________________________ Zope maillist - Zope(a)zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev ) ********************************************************************** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This footnote also confirms that this email message has been swept by MIMEsweeper for the presence of computer viruses. www.mimesweeper.com **********************************************************************

1 0

Re: Zope2.7.4 with Python2.4?
by Luis N 20 Apr '05

20 Apr '05

Hi, >Zope appears to be defaulting, and running with Python2.4 > >Forgive my newbieness, but might this be because I did something silly like: > >> python mkzopeinstance.py > >rather than, > >> /usr/local/bin/python2.3 mkzopeinstance.py > >when the instance was first created? nm, I fixed 'runzope', and 'zopectl' to reflect the appropriate python.

2 1

Convert Photos to ExtImage store
by David Chandek-Stark 19 Apr '05

19 Apr '05

I have a few PhotoFolders containing Photos that are stored in the ZODB which I would like to convert to ExtImage storage. Since the number is large enough to make a manual process painful, I'd like to write a conversion script. Seems simple enough in principle, but I'm having trouble getting started. First, how do you use manage_addPhoto()? I assumed that photo_folder.manage_addPhoto() would work, but I get AttributeError: manage_addPhoto Ideally, the script would operate on a PhotoFolder object, say, making a new PhotoFolder, then creating all the new Photos based on the old ones. I can manually delete the old folder and rename the new one. Thanks, David Zope 2.7.0/Python 2.3.2 Photo 1.2.3

2 2

Using USB smart token with Apache-enabled Zope web site
by Rich3800＠aol.com 19 Apr '05

19 Apr '05

I would like to create a collaborative environment where people would work on Blender files (among other file types) with yet unknown parties and enforce 2-way authenticated access to the Zope web site with smart tokens. I want also manage the Zope web site from behind my NAT router. How do I go about this?

3 2

(no subject)
by Maslak, Michael 19 Apr '05

19 Apr '05

Hi All, How do I install multiple instances of Zope that are valid Windows Services in W2K3 w/ SP1 installed? i.e. start like an automatic service on startup? Only the initial instance that gets created during the installation process gets associated with a Hardware Profile, "Profile1" here. (cmd: services.msc -> Zope Instance at D:\Core-Instance -> Log On tab -> Profile1 is listed in the properties. If I try to run the Zope installer again to create another Windows service instance, it does not get associated with a Hardware Profile like the first. (e.g. services.msc -> Zope Instance at D:\Next-Instance -> brings up a complaint dialog: "Configuration Manager: The specified Device ID is not a valid Device ID. Indeed, the properties box has NO entry for a Hardware Profile of any kind. And all other services created with the Create Zope Instance tool require manual start. Thank you. Michael Maslak

1 0

Firefox manage_changePermissions issue?
by Tony Addyman 19 Apr '05

19 Apr '05

I have experienced the following problem on two separate Zope/Plone sites. It is reasonably repeatable, but sometimes works without problem. I have a ZODB saved for testing purposes. I have tried fsrecovery.py on the database. It is not corrupted. Firefox fails on this database every time. The scenario: I change a permission setting using the ZMI of a Plone Site. I press the Save Changes button. Firefox sends a POST .../manage_changePermissions message to make the required change. A 200 response is returned. Firefox then immediately sends a GET .../manage_changePermissions without any interaction from the user. This totally destroys the permission settings for the object. Naturally, two transactions are logged, and undoing the second one fixes the error. However, it took over a day of digging to work this out, and the error is quite heart-stopping when it hits, because you are locked out of the object - in my case the entire Plone site. I can make this behaviour occur with Firefox repeatedly, but not quite always. If I continue to work on a site making changes and undoing them, sometimes the manage_changePermissions is only sent once. If I return to the "saved" ZODB and restart Zope, the duplicate sending happens in Firefox without fail. I have tried both Firefox-1.0.1 and Firefox-1.0.3. I have not managed to make it happen with Mozilla-1.7.2 or Konqueror-3.3.0, but I have been using Firefox most of the time because of the Live HTTP Headers extension. I have the logs, HTTP messages between browser and server, etc. I can't see anything in the Zope Access Control source which would cause a GET to be used after the POST. The GET is logged in the Firefox Live HTTP Headers, so it is not being generated further down the line by a proxy. I have a solution to apply next time this happens (use undo), but I would really like to track this one down. Any suggestions as to what to try next? I don't really want to study the Firefox source. I would rather learn about Zope and Plone :-) Thanks Tony Addyman -- Eur Ing A.M.Addyman, School of Computing, Science and Engineering University of Salford, Salford, M5 4WT

3 2

How to break up an external method over multiply source files
by Lucas Hofman 19 Apr '05

19 Apr '05

I have an external method a.py (in $INSTANCE_HOME/Extensions) that becomes to big to be in one python file. I have put some functions in b.py (also in $INSTANCE_HOME/Extensions) and want to use them from a.py. However 'import b' in a.py does not work. How to get this to work? Lucas

3 5

problems with *.zip and IE6 "behind" Apache
by robert 19 Apr '05

19 Apr '05

Hi there, Internet Explorer can not open *.zip files served by Zope. I use apache 2.49 and mod_deflate on Linux (Suse 9.1/2) I use the following rule to supress compression: # Don't compress images, java scripts and style sheets > #_robert_ pdf, gz hinzugeuegt > SetEnvIfNoCase Request_URI \ > \.(?:gif|jpe?g|png|js|css|pdf|gz|zip)$ no-gzip dont-vary This helps for pdf but not for zip files. The zip files load fine if I get ther directly from zope (by using a port number in the url) thanks for any hints Robert

2 1

Meta Type change
by David 19 Apr '05

19 Apr '05

Hi How do I change the meta_type for an object in the ZMI from within Zope? An instance of a product I have built (inheriting from the the Folder Product) has become inaccessible after adding a lot of data. Essentially this is a product to archive text strings in a specific format and has worked fine for months. The problem has lead to corruption of the Data.fs file (and fsrecovery.py did not find anything to recover). I had a few backups from which I was able to recover the rest of the site and of the archive in a previous state, but had to go back 3 days. The backup from the day before the corruption does have the object in the ZMI tree, but now Zope thinks this is a normal Folder and when I try to access it, gives me attribute errors. When I attempt an XML download, although there are errors, I can see all the archived texts in the text that is appearing in my browser, however they are embedded in chaotic-looking text garbage, so I can't find a way to extract them by script. (And there are about 5000 missing texts, so copy and paste would take days!) I was wondering if I could just alter the meta_type for the object from within Zope, maybe through a python script and see if that makes the object accessible again. I can't find anything on how to change the meta_type for an existing object though. Any help very appreciated. Cheers David

2 1

Problem with Zope Threads on Debain
by David 19 Apr '05

19 Apr '05

I have installed the zope debian (sarge) package. The default number of threads is 4 but only one thread is running. I installed this package in several machines and I have this problem in everyone. Somebody knows whats the possible problem? Sorry for bad english and thank for advance. David. -- -------------------------------------------- David Zapico <dzapico(a)neosystemssl.com> Neo Ingeniería Informática S.L. < http://www.neosystemssl.com > Tlfn/fax: 895 313 424 -------------------------------------------- --

2 1