- Zope - Zope lists

RE: [Zope] Force a ZODB transaction commit?
by Jim Kutter 22 Jul '04

22 Jul '04

Subtransactions did the trick. I set the subtransaction size rather small (100 records before commit), it did take quite a long time. However it seems to be working now, I've got all the records in there. The machine is fairly hefty, Athlon XP 2Ghz, with 1GB RAM. Is there any way to time how long a transaction takes to get comitted? I noticed that when the script finished executing, the catalog hadn't comitted the transactions yet (despite subtransactions being enabled - or at least I thought they were). It wasn't until I checked again hours later that I noticed the # of items in the catalog had been increased. -jim -----Original Message----- From: Chris Withers [mailto:chris@simplistix.co.uk] Sent: Thursday, July 22, 2004 5:00 AM To: Roché Compaan Cc: Jim Kutter; zope(a)zope.org Subject: Re: [Zope] Force a ZODB transaction commit? Roché Compaan wrote: > I am sure that the catalog is not the culprit here - I regularly index > 300k objects in one go. Your instance freezing could be due to memory > consumption, committing a transaction every n records will help keep > that in check. ZCatalog does this by default with subtransactions. I'd look at the script doing the indexing, along with how much RAM the server has... cheers, Chris -- Simplistix - Content Management, Zope & Python Consulting - http://www.simplistix.co.uk 271 North Avenue Suite 1210 New Rochelle, NY 10801 ebizQ Links Webinars http://www.ebizq.net/webinars/?campaign=exchange White Papers http://www.ebizq.net/white_papers/?campaign=exchange

1 0

Re: i18n local content
by Josef Meile 22 Jul '04

22 Jul '04

> Actually we don't use the 1.1 branch with all the fancy stuff that > Juan-David has added (...). Plain 1.0.1 > works well. So, the last version (1.1.0a3) might be broken after all. >... (about which I don't see the point) ... The point is that in my original post I was talking about the last version 1.1.0a3 and not about the old one. Please noticed also that now the last version is supposed to work with python 2.2 or greater. The old one works also with 2.2.x, but you get deprecation warnings when installing it. That's why I installed the newest. I also think that some how when you release a new version of a software, it has some new features/improvements and/or bug fixes that make it better. However, it could have also have new bugs. That's why it has to be tested by the final users. I also said that it was unsupported because I posted a message to the localizer list last month reporting the bug and I didn't get any answer. But I was wrong . Juan-David just published a message on the Localizer list and said that he's currently working on Localizer. He's working more on itools and iKaaro, but it's good to now that this project is still alive and that there is also other people working on it. I think also that it's important to make public that this version doesn't work, so, other people will now know that they have to install 1.0.1 on production servers. I spend lots of time because I didn't found a message that confirmed it and nobody told me. So I thaugth it was only a problem I was having. Regards, Josef

2 1

ZPT Help!
by Michael Fox 22 Jul '04

22 Jul '04

Hi *, I have a folder which contains a bunch of ZPT's and images, some of which share the same unique ID as a ZPT which a ".jpg" extension. ie. 1000 1000.jpg 1001 1002 1003 1004.jpg 1004 I have an index_html object which will render any ZPT in this directory and the matching image, if available. If there is no matching image I want to display an "image unavailable", but can't get this to work. There are currently no items available. Regards, Michael Fox ^-^ Analyst/Programmer <`-`> ___ Century Software ' `' '. Tel +61 2 9460 1422 `. ` ' .'. Fax +61 2 9460 3098 ||.' '._/'.`.' www.CenturySoftware.com.au "" "

4 3

[Fwd: Re: AW: [Zope] ZMySQLDA]
by harshad behere 22 Jul '04

22 Jul '04

-- Harshad Behere ZeOmega (www.zeomega.com) Open Minds' Open Solutions 20/21,Rajalakshmi Plaza, South End Road, Basavanagudi Bangalore-560 004 India

2 1

Force a ZODB transaction commit?
by Jim Kutter 22 Jul '04

22 Jul '04

Hi I'm trying to use ZCatalogs excellent indexing capability as a front end for data mining. We have 80k records which I'm reading using a ZSQL method (which also uses a custom base class for the records), for each record I then have to pull in data from three other tables, then I add that virtual object to the catalog. All of this is done via a python script. Here's the kicker: Zope takes forever to do this, and it tends to freeze the zope instance while it's doing it, in fact I have yet to successfully do this for a batch size larger than 100 records. My suspicion is that zope is doing this all in a transaction, and not committing the change per object, but instead waiting for the whole 80k records to be worked on, then commit the whole bag. Needless to say this isn't optimal. Is there a way I can force the transaction to commit after each record is done? Here's my code (the getXXX are ZSQL methods, the container is a ZCatalog object): ----------------------------------------------------- if user_id: users = context.getUsers(user_id=user_id) else: users = context.getUsers() for user in users: features_read = context.getReadFeatures(user_id=user.user_id) user.addFeatures(features_read) interests = context.getInterests(user_id=user.user_id) user.addInterests(interests) mailings = context.getMailings(user_id=user.user_id) user.addMailings(mailings) applications = context.getApplications(user_id=user.user_id) user.addApplications(applications) uid = '%s' % user.user_id container.catalog_object(user, uid) ------------------------------------------------------ 271 North Avenue Suite 1210 New Rochelle, NY 10801 ebizQ Links Webinars http://www.ebizq.net/webinars/?campaign=exchange White Papers http://www.ebizq.net/white_papers/?campaign=exchange

3 2

ZPT can't read protected info retrieved by authorized script
by Toni Vicens 22 Jul '04

22 Jul '04

Hi, I'm new to Zope development and I'm quite stuck with the following problem: I'm building a website with Zope, postgresql and exUserFolder. One of the tables of the postgresql DB stores addresses from different website users. I have built a ZSQL method which retrieves users addresses from that table taking the user identifier as the input variable. The thing is that I would like to assure that each user can only read his own addresses. To accomplish this I have done the following: I have put the ZSQL method in a folder (sql/restricted) where only owners and managers have “access content information” and “view” permissions (my users have member roles). Then I have written a python script with “owner” proxy role with the following code: request = container.REQUEST user = request.AUTHENTICATED_USER regs = container.sql.restricted.my_zsql_method(user_id=user.getUserId()) The problem is that when I call this method from a Page Template I get the following error: Unauthorized: You are not allowed to access 'attribute1' in this context. Finally I wrote an external method with the following code: user = REQUEST.AUTHENTICATED_USER addresses = self.sql.restricted.my_zsql_method(user_id=user.getUserId()) cp_addresses = [] for address in addresses: address_dict = {} for key in addresses._schema.keys(): address_dict[key]=address_dict [key] cp_addresses.append(address_dict) return cp_addresses and this works. But there MUST be an easier and more efficient way of doing it!!! Does someone know what I'm missing? Thanks a lot, Toni.

1 0

ZPT can't read protected info retrieved by authorized script
by Toni Vicens 22 Jul '04

22 Jul '04

Hi, I'm new to Zope development and I'm quite stuck with the following problem: I'm building a website with Zope, postgresql and exUserFolder. One of the tables of the postgresql DB stores addresses from different website users. I have built a ZSQL method which retrieves users addresses from that table taking the user identifier as the input variable. The thing is that I would like to assure that each user can only read his own addresses. To accomplish this I have done the following: I have put the ZSQL method in a folder (sql/restricted) where only owners and managers have “access content information” and “view” permissions (my users have member roles). Then I have written a python script with “owner” proxy role with the following code: request = container.REQUEST user = request.AUTHENTICATED_USER regs = container.sql.restricted.my_zsql_method(user_id=user.getUserId()) The problem is that when I call this method from a Page Template I get the following error: Unauthorized: You are not allowed to access 'attribute1' in this context. Finally I wrote an external method with the following code: user = REQUEST.AUTHENTICATED_USER addresses = self.sql.restricted.my_zsql_method(user_id=user.getUserId()) cp_addresses = [] for address in addresses: address_dict = {} for key in addresses._schema.keys(): address_dict[key]=address_dict [key] cp_addresses.append(address_dict) return cp_addresses and this works. But there MUST be an easier and more efficient way of doing it!!! Does someone know what I'm missing? Thanks a lot, Toni.

1 0

RE: [Zope] ZPT Help!
by Michael Fox 22 Jul '04

22 Jul '04

That's work great, thanks Paul! -----Original Message----- From: zope-bounces+michael=centurysoftware.com.au(a)zope.org [mailto:zope-bounces+michael=centurysoftware.com.au@zope.org] On Behalf Of Paul Winkler Sent: Wednesday, 21 July 2004 3:21 AM To: zope(a)zope.org Subject: Re: [Zope] ZPT Help! On Tue, Jul 20, 2004 at 03:59:22PM +1000, Michael Fox wrote: > If there is no matching image I want to display an "image > unavailable", but can't get this to work. > > > > > > That can't work. objectIds() returns a list of IDs and takes no arguments. The simplest thing would be: That could be problematically slow if there are a whole lot of objects in the folder. You could also try: ... but that is only good if you know that objects with the image ID will not be acquired from elsewhere in the current context. -- Paul Winkler http://www.slinkp.com _______________________________________________ Zope maillist - Zope(a)zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )

2 1

Proper zope install method + eventual use at port 80
by Steven Hodgen 21 Jul '04

21 Jul '04

I'm somewhat confused. The default install location for Zope is /opt. In order to install here, you must do it via root. The only thing I've done as root, is 'sudo make install', since I must. Now, the installation tutorial on 'plope.org', recommends doing it this way, although it is true that the INSTALL.txt file in doc/ does recommend not installing as root, but the default location would seem to indicate otherwise. I've seen references to installing to /usr/local, and a user's /home. Please understand that I'm not a linux expert. I have, however, been a software engineer for years, since '80, but only recently have I started exploring linux. At this point, the proper method for utilizing the linux directory hierarchy is a bit of a mystery. All I know is that I want to install Zope in a way which is most consistent with the intent of Linux Filesystem Hierarchy "standard?", which is somewhat unclear as to where third party software should be installed. It seems that /usr/local and /opt are valid locations, with /opt being, perhaps, primary. That being the case, /opt would seem a very reasonable place to put Zope, although based on this standard Zope's log files should be somewhere in /var/log, and it's data files somewhere else in /var, since the data changes via ZMI? Please overlook what may be obvious ignorance. You may well feel that Installing and running Zope is not the best tutorial for a linux newbie, but that's how I learn everything. I just jump in with both feet. I want a secure system, and perhaps 8080 is good for now, but I would want to be able to easily change to 80 without having to reinstall Zope, etc. Based on some reading, I was under the impression that it was ok to run Zope as root, since it automatically lowered it's user status to the one in zope.cfg after performing some root required initializations. Ok, I'm finished displaying my newbie status, at least for the moment. :-) Thanks for your help and patience. --Steven

2 1

Configuring ZOPE to use Apache users
by Gunther H.Weber 21 Jul '04

21 Jul '04

Hello everyone, I am trying to configure ZOPE to accept users authenticated by an Apache web server. (Mainly because I need to use a homebrew authentication service for which an Apache module is provided and maintained.) So far I have set up Apache (2.0.46) to access ZOPE (2.6.0) via FastCGI (as I couldn't get PCGI to run). The documentation in doc/WEBSERVER.txt explains how to set up Apache authentication via PCGI, but doesn't mention FastCGI in that paragraph. Is it at all possible to set up ZOPE to use remote users FastCGI? How would one do this. One of my problems is that the original server was set up by someone else and I need to make changes to the existing configuration. One problem may be that I did not find a file "access" in ZOPE's "var" directory. Naively I tried to create one containing just the name of a valid username on the Apache server folowed by a colon, in hope that Zope would use that. Still, I get two authentication requests, one by Apache and one by ZOPE. Where, except in the "var" directory could the "access" file reside? Any other ideas on what I am doing wrong? Any help would be greatly appreciated. Thank you. Gunther Weber

3 2