March 2005 - Zope - Zope lists

RE: [Zope] Troubleshooting Zope 100% CPU utilization
by Matthew X. Economou 15 Mar '05

15 Mar '05

All, I was able to get DeadlockDebugger working. I think my initial threadframe installation was corrupt, but re-installing both threadframe and DeadlockDebugger seemed to fix any issues there. With the following output, do I have enough information to go to someone with a bug report? At this point it seems Zope isn't the problem, but I want to know if there is any other information I can glean before reporting a bug in LDAPUserFolders or python-ldap. So: I have a spinning Zope and the DeadlockDebugger output. The last few lines of each thread look like: File "/var/www/zope/Products/LDAPUserFolder/SharedResource.py", line 110, in __call__ self._lock.acquire() File "/usr/local/lib/python2.4/threading.py", line 100, in acquire rc = self.__block.acquire(blocking) One thread is stuck here (possible race condition?): File "/usr/local/lib/python2.4/site-packages/ldap/ldapobject.py", line 169, in simple_bind return self._ldap_call(self._l.simple_bind,who,cred,serverctrls,clientctrls) File "/usr/local/lib/python2.4/site-packages/ldap/ldapobject.py", line 91, in _ldap_call self._ldap_object_lock.acquire() And finally, one thread is stuck here: File "/var/www/zope/Products/LDAPUserFolder/LDAPDelegate.py", line 292, in _connect connection.simple_bind_s(user_dn, user_pwd) File "/usr/local/lib/python2.4/site-packages/ldap/ldapobject.py", line 760, in simple_bind_s return SimpleLDAPObject.simple_bind_s(self,*args,**kwargs) File "/usr/local/lib/python2.4/site-packages/ldap/ldapobject.py", line 176, in simple_bind_s self.result(msgid,all=1,timeout=self.timeout) File "/usr/local/lib/python2.4/site-packages/ldap/ldapobject.py", line 399, in result res_type,res_data,res_msgid = self.result2(msgid,all,timeout) File "/usr/local/lib/python2.4/site-packages/ldap/ldapobject.py", line 405, in result2 return self._ldap_call(self._l.result2,msgid,all,timeout) File "/usr/local/lib/python2.4/site-packages/ldap/ldapobject.py", line 94, in _ldap_call result = func(*args,**kwargs) What do these thread backtraces show? What additional information can I gather? Best wishes, Matthew -- "The challenge of a moral life is to do nothing that requires forgiveness." - Roger Ebert in his review of _The Woodsman_

1 0

Problems with removing Verbose Security and possibly Apelib
by Chris Kratz 15 Mar '05

15 Mar '05

We've run into a very strange situation. We been running zope 2.7.3 with Abelib 1.0 and Verbose Security 0.6. Verbose Security is great during development, but it does cause somewhat of a performance hit on a live server. So, recently after profiling our app in zope and finding that Verbose Security was eating a fair amount of time, I decided to try and remove it on our production systems. I removed the Verbose Security from the products directory and from the Products list in the control panel and tried the app again. Unfortunately, this causes the app to break. What appears to happen is that on any object we have used proxy settings on, when run without verbose security, we get a security error. If I go into that object on to the proxy tab, the roles are still selected and clicking update (with making no other changes), "fixes" the problem for a user. What is even weirder is that because we are using apelib, it is easy to see the changes made to the object when we make changes in the zmi. In this particular instance, we can see that even though the object was saved in the ZMI, and the files on disk were modified, the contents of the objects did not change when we updated the proxy settings, yet zope now appears to obey them. The last piece of the puzzle is that returning the VerboseSecurity product allows the application to start working again, proxy roles and all. Any ideas as to why this might be? Is there a chance that the monkey patching Verbose Security does is not reversible? Or is there some weird problem caused by using Verbose Security and Apelib? Thanks for your time, -Chris --- Error example Error Type: Unauthorized Error Value: You are not allowed to access 'select' in this context ...last lines in traceback # PythonScript at /somefunction> Line 3 # Module Shared.DC.Scripts.Bindings, line 178, in __getattr__ Unauthorized: You are not allowed to access 'select' in this context

2 3

RE: [Zope] Troubleshooting Zope 100% CPU utilization
by Matthew X. Economou 15 Mar '05

15 Mar '05

The story thus far: 1. I installed DeadlockDebugger, but I couldn't get it to work. I kept getting errors when I tried to view its special URL, so I gave up on getting it working. 2. I upgraded to Python 2.4 as there were some fixes to threading support that haven't been backported to Python 2.3. Now, instead of hanging the entire instance when Zope begins spinning, it only hangs the Plone site (and I can access the Zope instance's root). 3. In my backtraces using GDB, I saw that Zope is stuck in a select loop waiting on an LDAP connection (I'm using LDAPUserFolders to authenticate to Active Directory). I don't know if the problem is in LDAPUserFolders, python-ldap, or OpenLDAP's client libraries. What is especially frustrating is that this same software works fine on a different architecture. The LDAP connection is in a CLOSE_WAIT state. The Zope instance sends a FIN/ACK and receives an ACK from the domain controller. The domain controller sends a FIN/ACK, but Zope never sends the final ACK to close the connection. Instead, it spins around a call to select(2) with the connection stuck in CLOSE_WAIT. I will continue to try to get DeadlockDebugger working and follow up with Dataflake, the python-ldap-dev mailing lists, or with the OpenLDAP maintainers (as the case may be). As always, your suggestions are most welcome. Best wishes, Matthew -- "The challenge of a moral life is to do nothing that requires forgiveness." - Roger Ebert in his review of _The Woodsman_

2 1

Storing blobs in a RDB
by Marco Bizzarri 15 Mar '05

15 Mar '05

Hi all. We have a zope/zeo/postgres configuration. We need to store blob on the RDB, which is on a different machine from zope. When the RDB and zope were on the same machine, this was achieved via creating a temporary file, and then submitting the file to postgres, via the lo_import/lo_export interface. Now this can't be done anymore. Is there any viable solution? What I thought to do was to put a zeo on the same machine as postgres, create a file or some object like that on the zeo storage, and then instruct postgres to get the file from there. But is this feasible? I've tried with DirectoryStorage, but it is storing other infos with the file (of course). Any suggestion? Regards Marco

2 1

RE: [Zope] Re: Blocking Sibling inheritance
by Jay Zeemer 15 Mar '05

15 Mar '05

Greg, You just described my problem to the letter. This is the issue that is impacting me currently. The only way we have successfully blocked this is to add an object to every customer folder that represents every other customer. We have been trying to make a folder-ish object with Acquisition.Implicit but so far have had no success. Besides adding a customer# object for every customer to every customer can anyone tell me how I can block this from happening?? Jay -----Original Message----- From: Greg Fischer [mailto:retheoff@gmail.com] Sent: Thursday, March 03, 2005 3:36 AM To: zope(a)zope.org Subject: Re: [Zope] Re: Blocking Sibling inheritance Security issue? I think you are partially right about it not being a security issue because Zope does what it is supposed to do and look where it should. Here is a security issue relating to this acquisition: (IMHO) I have folder 1: /site/dev/customer1/folder/page And folder 1: /site/dev/customer2/folder1/folder2/page Eash customer level folder has acl_users with different/separate accounts. The security at the customer level folder is set to not acquire and no anonymous access. Now here is the problem I see, you type in your URL: someplace.com/site/dev/customer1/folder/page You are asked to authenticate. Then you change your url after authentication to: somplace.com/site/dev/customer1/folder/customer2/folder1/folder1/page And you get right in with no authentication! That should not be allowable. I understand that this would require someone to know the folder structures, but really, in a more simplistic example, all you would need to know is the other client folder name, and you would have access. So what can we do about this? If you dont have acl-users account in a folder you access, you should NOT be able to see the contents. Right? This may be a new subject, I dont mean to stray off topic. On Thu, 3 Mar 2005 01:20:32 -0700, kosh <kosh(a)aesaeion.com> wrote: > On Thursday 03 March 2005 1:06 am, Dario Lopez-Kästen wrote: > > Tres Seaver wrote: > > > -----BEGIN PGP SIGNED MESSAGE----- > > > Hash: SHA1 > > > > > > Jay Zeemer wrote: > > > | Greetings all, > > > | I am in the process of examining Zope for some possible applications. > > > | Currently I am having an issue with Zope being a bit to smart. I have > > > | a directory \Dir1\ and under it I have 2 subdirectories \Dir1\SubA\ and > > > | \Dir1\SubB\. The problem I am having is I can go to \Dir1\SubA\SubB\ > > > | and gain access to things that are in \Dir1\SubB\, I need to be able to > > > | block sibling level inheritance. Is this possible in Zope?? Or are > > > | there any other ways to block this with out creating a SubB object in > > > > > > \Dir1\SubA\ ?? > > > > > > The "sibling inheritance" you are describing is Zope's "acquisition". > > > Folders derive from Acquisition.Implicit, which means they are willing > > > to acquire any "non-private" name from their parents. > > > > > > To prevent this behavior, place SubA with a Folder-like object which > > > derives instead from Acquisition.Explicit. > > > > I'd need this too. Would I be making a correct assumption when stating > > that no such folderish product, such as a "aq-blocking Folder", exists > > yet, but it has to be written (ie by me or anyonelse needing this > > functionality)? > > > > Thanks. > > > > I don't know of something like this existing and even more I don't know why > you would really want it. Eventually you will understand how and why > acquisition works and then you would have a fair bit of work to do to change > the stuff back. Zope is not publishing any object that the person viewing the > site would not normally have access to so it is not security issue. > > What you probably need to do is read the zope book and read about how > acquisition works. You can use it to make apps a lot faster and save yourself > a lot of work by learning how to use it. Acquisition is a major reason that I > use zope in the first place and have been using it for about 4 years now. > _______________________________________________ > Zope maillist - Zope(a)zope.org > http://mail.zope.org/mailman/listinfo/zope > ** No cross posts or HTML encoding! ** > (Related lists - > http://mail.zope.org/mailman/listinfo/zope-announce > http://mail.zope.org/mailman/listinfo/zope-dev ) > -- Greg Fischer 1st Byte Solutions http://www.1stbyte.com _______________________________________________ Zope maillist - Zope(a)zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )

8 13

Newbie - help with install in Suse 9.1 as root (and other questions)
by f2396576＠est.fib.upc.edu 15 Mar '05

15 Mar '05

Hello everyone, I am a zope-newbie and I'm trying to install zope from source as root. I install and compile python 2.3.3 and zope 2.7.4, creating a user for zope when I am asked, and I change .conf to effective-user myuser: but when I run zopectl, cannot found the user 'myuser' (and if I try as root, doesn't allow it to me). Of course, the browser don't find http://localhost:8080/ I need to install in linux because I have to create a collaborative editor in the web free source. Has also to be suse 9.1. Related to this: -To customize my own zope application, all the code to touch is the python code? - How exactly handles concurrency Zope? I mean, two people editing same page at the moment, how handles it? By database, by .py (what archive)...? - Can Zope call/integrate an application, like an external editor of .po files (also free software, probably KBabel)? Some people has said me that a wiki (Mediawiki) could be a good idea for this, but I am also trying Zope as it seems ascending and with much potential. I want to try both exhaustly before taking a decision. Thanks in advance Jordi

2 1

ENC: [Zope] LDAPUserFolder - Too many results for this query...
by Rodrigo Varela Simões 15 Mar '05

15 Mar '05

I´m having the same problem accessing Active Directory, through Plone/LDAPUserFolder/python-ldap. The AD´s size´s limit is 10.000 results, and I just have 2.500. When I try to view all users using the LDAPUserFolder interface I got the message "Too many results for this query". Do you have any idea how to fix it ? Best regards, ******************************************************************* Rodrigo Varela Simões Operações de TI Dedini S/A Ind. de Base (19)3403-3209 *******************************************************************

2 1

date/time woes
by tmc＠dreamcraft.com.au 15 Mar '05

15 Mar '05

Hi all Background: I am running a Linux system with Zope+Plone. My system clock is set to UTC(GMT) and my system knows the timeone its in - Australia Eastern Time (+1000 or +1100 for daylight saving). Problem: CMFcalendar isists in makeing all dates US/Eastern, and in fact sets many events forward or back in time. So do rest of Zope and Plone products. With all of this, I and my collegues are getting the jack of this behaviour and some dissenting voices argued for ditching zope as the framework in favour of somesthing "That can get the date right. Were not Americans." Question: How do I get Zope and its products to take account of my TZ settings? Is there a way to force ZOPE to live in my timezone instead opf some place in Eastern US, which is probaly a niceplace, is NOT where I am(!). Any advice? Regards Tomasz -- Tomasz M. Ciolek ******************************************************************************* tmc at dreamcraft dot com dot au ******************************************************************************* GPG Key ID: 0x41C4C2F0 GPG Key Fingerprint: 3883 B308 8256 2246 D3ED A1FF 3A1D 0EAD 41C4 C2F0 Key available on www.pgp.net *******************************************************************************

2 1

Reset admin password on zope 2.7.4 on windows platform
by Richard De Vriese 15 Mar '05

15 Mar '05

Is there any way to reset the admin account password on zope 2.7.4 on a windows XP installation. I read through the zopectl information but that only seems to work on a Unix platform. I've got a zope instance I'd like to reactivate, but don't remember the admin name or password. Thanks Rick

2 1

ZCatalog PathIndex Query
by Nathan Colgate Clark 15 Mar '05

15 Mar '05

In an 'advanced search' interface i would like to provide the ability to search using the path index of my catalog (index id: 'p', catalog id: 'Catalog'). A sample of my catalog: /site_root/publications /site_root/publications/newsletter /site_root/publications/newsletter/edition01/articleA /site_root/publications/newsletter/edition01/articleB /site_root/publications/magazine /site_root/publications/magazine/fall2003/articleC /site_root/publications/magazine/fall2003/articleD /site_root/publications/magazine/winter2003/articleE /site_root/publications/magazine/spring2003/articleF So that if the user were to type "magazine" into the field they would get the last 5 objects in my catalog. however, this does not work right now. currently i have to type "/site_root/publications/magazine" into the field. this is becuase the default level for pathIndex searches is 0 (line 154 of PathIndex.py). to change this I must pass the argument as a tuple (query,level) with the level set to -1. My question is this: how do I do that using the get method of a form? how do I pass the (query,level) tuple from the form in the URL? I have tried this: http://www.mysite.com/search?p=magazine&p=-1 which gives me a p variable of: ['magazine','-1'] but still does not give me any results.

2 1