October 2003 - Zope - Zope lists

RE: [Zope] Analyzing ZODB objects
by Bjorn Stabell 26 Oct '03

26 Oct '03

> From: Dieter Maurer [mailto:dieter@handshake.de] [...] > They can be far apart. Although, when your pickle is several > MB your object is not several bytes and vice versa. Well, in that case it might be useful for such a ZODB admin tool to show both sizes. It could be a combined cache analysis and ZODB browsing tool. [...] > I do not yet understand why you would want such a thing. > Can you provide use cases? I guess I want something very low-level, for use in debugging strange behavior, and for help in understanding how Zope apps are built. The ZMI works with object interfaces, which is useful, but requires that each object supports an interface (ObjectManager etc). Many objects don't, especially not when you're developing them :) For this reason--no access to data except through application-provided interfaces--ZODB feels much like a "black box" to me. Example use cases include: - SPACE AND MEMORY OPTIMIZATION. Reducing ZODB size, and Zope memory usage. I've got some huge objects in my database, which ones are they? Why are they huge? If I know this, I can optimize. (Related: My Zope uses a lot of memory; why? Objects of which class, and in which location, uses the most memory? Why were they loaded? At the ZMI level, you don't want to know if objects are loaded/ghosted.) - UNDERSTANDING CONTENT TYPES AND TOOLS. What is the difference in the data structure of PloneDocument and CMFDocument? - DEBUGGING CLASS MIGRATION PROBLEMS. Some older objects are exhibiting strange behavior; what is the difference in data structure between them and the new objects? Which objects of class X doesn't have attribute A set? (Except for the obvious Zope/CMF/Plone/Product upgrades, these kinds of problems happen a lot during development each time a class is changed without recreating its objects.) - VERIFYING AND IMPROVING DATA STORAGE SCHEMAS. Does class X really store the attributes I thought it would? - CHANGING A PROPERTY THAT DOESN'T HAVE A MANAGEMENT INTERFACE. For debugging, testing, or migration purposes, or for just fixing a one-off bug. The truth is, I think this kind of tool will "open my eyes" to what's in the ZODB and take much of the guesswork out of developing with Zope, similar to the eye opening experience a RDBMS admin tool is. I often write scripts to analyze object structure and do simple changes; I wish, however, that there would be an admin environment that provided: - A database browsing / object inspector tool, taking away the need to write scripts for browsing/changing objects in most cases, and encouraging people to analyze and understand the database structure - A query language that would make it even easier to write scripts (+ ZODB index support?) - A place to store one-off scripts so they don't get mixed up with the application Something like this http://www.pgadmin.org/pgadmin3/screenshots.php, but for the ZODB. Regards, -- Bjorn

12 16

python-ldap in ZOPE (again)
by Adam Szpakowski 26 Oct '03

26 Oct '03

Hi, Few days ago I reported a problem with using python-ldap from zope. Now I set up the ZEO enironment to trace the problem and still have no idea why it is not working. Here is description... external method in zope: #t1.py def test(): i_ldap = ldap.initialize('ldap://address_to_ldap_server') i_ldap.simple_bind_s('','') return i_ldap The LDAP server is up and working. Zope gets segfault when trying to run this extmethod (exactly binding to server). Test from python session connected to ZEO server... 'h' is an external method object in ZODB... e.g.: h.getFuncCode().co_varnames -> ('i_ldap') Running this in pdb effects in: -> pdb.run(h()) Segmentation fault This is en effect of binding to LDAP (simple_bind_s('','')). Now I have no idea what I'm doing wrong. Any clues? Current setup: Zope 2.7b2, python2.3-ldap (v. 1.9.999.pre13-1), python v. 2.3.2-2 under Debian. TIA, -- Adam Szpakowski Silesian University of Technology - Institute of Physics Department of Optoelectronic e-mail: worf(a)optics.polsl.gliwice.pl

2 2

Python Script to Import Content into Zope?
by Simone Unold 26 Oct '03

26 Oct '03

Hi, my question is if there is some kind of Python Script available to update Content into Zope. I'm programming C++ and thought, that there may be a possibility to call a Python Script in order to automatically import content to zope?! Can anybody help me, has anyone an idea? Thanks a lot! Bye Simone

2 1

newSecurityManager w/ LDAPUserFolder still doesn't work for me!
by Brad Clements 26 Oct '03

26 Oct '03

I'm using Zope 2.7.0 a1 I want to be able to 'su' as another user within Zope if a PythonScript is called with valid REQUEST.form values. Attached below is my extension method, which sorta works. The problem is that after I call newSecurityManager, the 'new user' doesn't have View rights to the User object, so calling getProperty() on it fails. I'm using LDAPUserFolder It seems this should work, but doesn't. I've tried various combinations of .__of__ wrapping of the user object. Nothing works. The following extension method, when called correctly, produces this output: current user is backend with roles ('SU', 'Authenticated') has view on user object? 1 set user is darcie with roles ('SFCustomer', 'SFManager', 'Anonymous', 'Authenticated') has view on user object? 0 This extension module is called like so from PythonScript: from AccessControl import getSecurityManager context.processSU(context) user = getSecurityManager().getUser() orgid = user.getProperty('orgid',None) I get "Unathorized" on the getProperty call if processSU() has switched the user -- def processSU(context, request=None): """Given an acquisition context and request context, become the specified user if request.form has a variable named _su and if that specifies a valid user, then we'll become that user. su must be the dn of an ldap user to become """ if not request: request = context.REQUEST su = request.form.get('_su') if not su: return sm = getSecurityManager() currentUser = sm.getUser() print "current user is ",repr(currentUser),"with roles", currentUser.getRoles() print "has view on user object?", currentUser.has_permission('View', currentUser) if not currentUser.has_role((suRequiredRole,)): # this is an error raise RuntimeError("Insufficient rights to ZopeSecurityTool process 1") userFolder = context.acl_users newUser = userFolder.getUserByDN(su) if newUser is None: raise RuntimeError("Specified user not found") newUser = newUser.__of__(getattr(userFolder,'aq_base', userFolder)) newSecurityManager(None, newUser) sm = getSecurityManager() newUser = sm.getUser() print "set user is ",repr(newUser), "with roles", newUser.getRoles() print "has view on user object?", newUser.has_permission('View', newUser) -- Brad Clements, bkc(a)murkworks.com (315)268-1000 http://www.murkworks.com (315)268-9812 Fax http://www.wecanstopspam.org/ AOL-IM: BKClements

2 2

RE: [Zope] Controlling caching of objects
by Bjorn Stabell 26 Oct '03

26 Oct '03

> From: Toby Dickenson [mailto:tdickenson@geminidataloggers.com] > Yes. The default of 4 threads is arguably too high. All my > applications work > better with 2 threads, and double the cache size (but still > using the same total amount of memory) I'm experimenting with that now. A catalog query that used to take 40-100 seconds with the default target number of objects in the cache now takes 1-2 seconds (or less) with the target number increased to 15,000. This 100x speed increase comes at the cost of using 0.5 GB of resident memory with 4 threads. > They need to be seperate to give isolation between > transactions. Some classes > that allocate large amounts of memory for immutabe objects > have custom optimisations to share those between threads. This is very unfortunate, especially given that most of these objects won't be changed often. Something like the the way virtual memory works (copy-on-change) would have saved a lot of memory, or allowed you to keep many more objects in the cache, increasing speed drastically. Is this in any way related to the inherent global interpreter lock limitation in Python? Bye, -- Bjorn

6 7

ReST to PDF
by Samir Mishra 26 Oct '03

26 Oct '03

Hello all, Has anyone done any work on converting a ReST object to PDF? I have been looking at the Reportlab module as well as html2pdf, and feel Reporetlab may be better for this. Any suggestions? Comments? Pointers? Thanks in advance. Regards, Samir

1 0

Problems migrating site
by Jesper Holmberg 26 Oct '03

26 Oct '03

I am trying to move my Plone site to a different server. But when I access some of the content on my site at the new location, I get error messages. This is what I have done: 1. Installed Zope, CMF, Plone and all relevant Products I use on the new server 2. Exported my Plone site in the ZMI of the old server, and imported it in the new server. 3. Ran the scripts found at http://cmf.zope.org/Members/cleath/movePortal, which supposedly updated the skins, and updated any ownership information. As an example, when I hit "my preferences", I get the errors: Site error This site encountered an error trying to fulfill your request. The errors were: Error Details Error Type AttributeError Error Value getActions Obviously there is something which misses the attribute getActions, but what does it mean? The backtrace from when I try to access "my preferences" goes like this (sorry so long): Traceback (innermost last): Module ZPublisher.Publish, line 98, in publish Module ZPublisher.mapply, line 88, in mapply Module ZPublisher.Publish, line 39, in call_object Module Shared.DC.Scripts.Bindings, line 252, in __call__ Module Shared.DC.Scripts.Bindings, line 283, in _bindAndExec Module Products.PageTemplates.ZopePageTemplate, line 228, in _exec Module Products.PageTemplates.PageTemplate, line 95, in pt_render <ZopePageTemplate at /wlplone/personalize_form> Module TAL.TALInterpreter, line 200, in __call__ Module TAL.TALInterpreter, line 244, in interpret Module TAL.TALInterpreter, line 703, in do_useMacro Module TAL.TALInterpreter, line 244, in interpret Module TAL.TALInterpreter, line 726, in do_defineSlot Module TAL.TALInterpreter, line 244, in interpret Module TAL.TALInterpreter, line 669, in do_condition Module TAL.TALInterpreter, line 244, in interpret Module TAL.TALInterpreter, line 669, in do_condition Module TAL.TALInterpreter, line 244, in interpret Module TAL.TALInterpreter, line 414, in do_optTag_tal Module TAL.TALInterpreter, line 399, in do_optTag Module TAL.TALInterpreter, line 394, in no_tag Module TAL.TALInterpreter, line 244, in interpret Module TAL.TALInterpreter, line 669, in do_condition Module TAL.TALInterpreter, line 244, in interpret Module TAL.TALInterpreter, line 668, in do_condition Module Products.PageTemplates.TALES, line 220, in evaluate URL: /wlplone/personalize_form Line 492, Column 12 Expression: standard:'personal' Names: {'container': <PloneSite instance at 9383130>, 'default': <Products.PageTemplates.TALES.Default instance at 0x873476c>, 'here': <PloneSite instance at 9383130>, 'loop': <SafeMapping instance at 9423980>, 'modules': <Products.PageTemplates.ZRPythonExpr._SecureModuleImporter instance at 0x873490c>, 'nothing': None, 'options': {'args': ()}, 'repeat': <SafeMapping instance at 9423980>, 'request': <HTTPRequest, URL=http://130.237.161.108/wlplone/portal_form/personalize_form>, 'root': <Application instance at 92d91c0>, 'template': <ZopePageTemplate at /wlplone/personalize_form>, 'traverse_subpath': [], 'user': Pepsi} Module Products.PageTemplates.Expressions, line 206, in __call__ Module Products.PageTemplates.Expressions, line 201, in _eval Module Products.PageTemplates.Expressions, line 108, in render Module Products.CMFPlone.PloneFolder, line 89, in __call__ Module Products.CMFPlone.PloneFolder, line 180, in _getViewFor AttributeError: getActions What is missing? TIA, Jesper

4 3

Propblems with Install xmlMthods
by Thull, Stefan 25 Oct '03

25 Oct '03

Hello I have zope 2.6.1 running on my win xp. I have installed it with the win-binary. I want to use XmlMethods. According to the install-instruction I did: I had already python 2.3 on my computer so I downloaded the 4suite 1.0a3 for python 2.3 and PyXML 0.8.3 I installed both with the win-installer. I could check, that 4suite is running. I do not know how to check if PyXML is running. Then I installed XmlMethods and I had the XSL Method and the XSLT Cache Manager in ZMI available. Now, as I tried to test the test-files it says No supported XSLT processors available What went wrong? Should I have to install the 4suite in the python 2.1 installation, which came with the zope-binary? Thanks in advance for every help Stefan

1 0

site error
by Kai Vermehr 25 Oct '03

25 Oct '03

just added a virtual_host_monster and didn't notice I already had one installed ... so after noticing it I deleted the one I added latest. Now I can't access the site or the Zope manage area anymore ... all pages display this error messages: Site Error An error was encountered while publishing this resource. Resource not found Sorry, the requested resource does not exist. Check the URL and try again. Resource: VirtualHostBase GET what can I do? 'K:(

2 3

Re: [Zope] Changing the name of the access log file
by cnk＠caltech.edu 25 Oct '03

25 Oct '03

OK one of the servers allowed me to change my log file name - and the other one still is called Z2.log. Must be user error. Will sort that out later. Daily log rolling seems to work - though I am still fighting with changing the name of the archived files. Hopefully restarting the server will give me joy - otherwise I seem to have modified the wrong line in logger.py. But I decided to take my giant log file and use grep to break it into smaller pieces to run through Analog to get some web stats. However, Analog complained about EVERY line. There seems to be an extra space between the IP address and the next argument whose function I never recall because the value is always "-". I did a global search and replace and re-ran the file and it processes just fine (ignoring the diffuculties of determining which requests count as pages in a world where urls do not have file type extensions). I searched for ZServer + Analog and Zope + Analog and turned up some posts - none of which reported any difficulties. Is anyone else currently using Analog to run statistics on their Zope sites? and have you had any similar difficulties? I am using Analog 5.31 and Zope 2.6.1. -- cnk(a)caltech.edu

4 3