March 2005 - Zope - Zope lists

Re: IE7 for Zope
by Greg Steffensen 24 Mar '05

24 Mar '05

I sent an email to this list announcing a product (a Zope wrapper for the IE7 javascript tool) that wasn't publicly visible- sorry. I'm trying to change that, but those of you that said you were interested can try it out using the attached Zope XML export file. Import it, then add <dtml-var "ie7.tag()"> (or something analagous) to the head section of whatever pages you want to use it on. Greg

1 0

Zope hangs with Ape and large number of objects
by Francis Kelly 24 Mar '05

24 Mar '05

I'm having an issue with Ape that I'm hoping someone might have some insight into. I'm running Zope 2.7.3 on a Fedora Core 3 dual processor Xeon box with a gig of memory. I've got a FileStorage (generic Data.fs) as well as a file-based Ape storage. The Ape storage is based on the default file-storage that is described in the component.xml file that comes with Ape (I didn't create any mappers or anything). This is a development environment, so I'm running Zope in debug mode & I'm using VerboseSecurity. I've loaded about 700,000 objects, each of which is fairly small, probably <1k in size. I was interested in using Ape for a couple of reasons. Since the system will have a lot of objects in it (probably > 5M), I wanted to explore ways of storing those objects in more than one file to avoid a massive Data.fs file. Ape seemed appealing over mounted storage (though I still need to play around a bit more with that) because I don't care about undo support (once the objects are loaded they won't be modified hardly at all). My Ape storage is mounted at /fs. When I try to go into /fs via the ZMI, the system essentially hangs. Zope starts to consume more and more system resources (swapping increases as does top's average load value) and the system gets slower and slower. If I cancel the operation, that has no effect on the consumption of system resources; I have to restart Zope. I've attached a dump produced by the DeadlockDebugger product that I think captures the place where Zope seemed to be spending most of its time in the event that's helpful. Likewise, I used a reference counting routine to dump out the refs in the system. Here are the top 5, you'll see that Ape tops the list (which may be normal, I don't know): (2509, <class apelib.zodb3.connection.UnmanagedJar at 0xb7867e0c>) (301, <class Shared.DC.Scripts.Bindings.NameAssignments at 0xb79939ec>) (294, <class Shared.DC.Scripts.Signature.FuncCode at 0xb7993f8c>) (162, <class DocumentTemplate.DT_Util.Eval at 0xb79d1d1c>) (161, <class Products.ZGadflyDA.gadfly.kjParser.ParseRule at 0xb7191dac>) Any insight anyone has on this problem would be very useful. In general, recommendations on handling large numbers (>1M) of objects would be very useful as well. Thanks, Francis ----- stacktrace ------- Thread 126962608 (GET /fs/manage_main): File "/usr/local/zope2.7.3/lib/python/ZServer/PubCore/ZServerPublisher.py", line 23, in __init__ response=response) File "/var/zopescale/Products/ZopeProfiler/MonkeyPatcher.py", line 35, in __call__ return self._function(*args,**kw) File "/var/zopescale/Products/ZopeProfiler/ZopeProfiler.py", line 357, in _profilePublishModule request=request, response=response) File "/usr/local/zope2.7.3/lib/python/ZPublisher/Publish.py", line 384, in publish_module environ, debug, request, response) File "/usr/local/zope2.7.3/lib/python/ZPublisher/Publish.py", line 175, in publish_module_standard response = publish(request, module_name, after_list, debug=debug) File "/usr/local/zope2.7.3/lib/python/ZPublisher/Publish.py", line 101, in publish request, bind=1) File "/usr/local/zope2.7.3/lib/python/ZPublisher/mapply.py", line 88, in mapply if debug is not None: return debug(object,args,context) File "/usr/local/zope2.7.3/lib/python/ZPublisher/Publish.py", line 39, in call_object result=apply(object,args) # Type s<cr> to step into published object. File "/usr/local/zope2.7.3/lib/python/Shared/DC/Scripts/Bindings.py", line 306, in __call__ return self._bindAndExec(args, kw, None) File "/usr/local/zope2.7.3/lib/python/Shared/DC/Scripts/Bindings.py", line 343, in _bindAndExec return self._exec(bound_data, args, kw) File "/usr/local/zope2.7.3/lib/python/App/special_dtml.py", line 175, in _exec try: result = render_blocks(self._v_blocks, ns) File "/usr/local/zope2.7.3/lib/python/DocumentTemplate/DT_In.py", line 643, in renderwob sequence=self.sort_sequence(sequence, md) File "/usr/local/zope2.7.3/lib/python/DocumentTemplate/DT_In.py", line 771, in sort_sequence else: k = getattr(v, sort) File "/var/zopescale/Products/Ape/lib/apelib/zodb3/connection.py", line 359, in setstate event = osio.deserialize(oid, obj, classification, state) File "/var/zopescale/Products/Ape/lib/apelib/core/io.py", line 160, in deserialize mapper.serializer.deserialize(event, state) File "/var/zopescale/Products/Ape/lib/apelib/core/serializers.py", line 121, in deserialize s.deserialize(event, state) File "/var/zopescale/Products/Ape/lib/apelib/zope2/products.py", line 69, in deserialize obj._setOb(id, subob) File "/var/zopescale/Products/BTreeFolder2/BTreeFolder2.py", line 230, in _setOb meta_type = getattr(object, 'meta_type', None) File "/var/zopescale/Products/Ape/lib/apelib/zodb3/connection.py", line 359, in setstate event = osio.deserialize(oid, obj, classification, state) File "/var/zopescale/Products/Ape/lib/apelib/core/io.py", line 160, in deserialize mapper.serializer.deserialize(event, state) File "/var/zopescale/Products/Ape/lib/apelib/core/serializers.py", line 121, in deserialize s.deserialize(event, state) File "/var/zopescale/Products/Ape/lib/apelib/zope2/products.py", line 69, in deserialize obj._setOb(id, subob) File "/var/zopescale/Products/BTreeFolder2/BTreeFolder2.py", line 230, in _setOb meta_type = getattr(object, 'meta_type', None) File "/var/zopescale/Products/Ape/lib/apelib/zodb3/connection.py", line 322, in setstate p, serial = self._storage.load(oid, self._version) File "/var/zopescale/Products/Ape/lib/apelib/zodb3/storage.py", line 102, in load event, classification, state, hash_value = self._gwio.load(oid) File "/var/zopescale/Products/Ape/lib/apelib/core/io.py", line 99, in load state, hash_value = mapper.gateway.load(event) File "/var/zopescale/Products/Ape/lib/apelib/core/gateways.py", line 67, in load state, serial = gw.load(event) File "/var/zopescale/Products/Ape/lib/apelib/fs/structure.py", line 111, in load classification = event.classify(child_oid) File "/var/zopescale/Products/Ape/lib/apelib/core/events.py", line 67, in classify return self.conf.classifier.classify_state(sub_event) File "/var/zopescale/Products/Ape/lib/apelib/zope2/classifier.py", line 136, in classify_state classification, serial = self.gateway.load(event) File "/var/zopescale/Products/Ape/lib/apelib/fs/classification.py", line 36, in load text = fs_conn.read_annotation(oid, 'classification', '') File "/var/zopescale/Products/Ape/lib/apelib/fs/connection.py", line 143, in read_annotation annotations = self.afs.get_annotations(path) File "/var/zopescale/Products/Ape/lib/apelib/fs/annotated.py", line 98, in get_annotations data = self.ops.readfile(props_fn, 1) File "/var/zopescale/Products/Ape/lib/apelib/fs/fileops.py", line 47, in readfile return f.read()

3 3

Help!!! How can I restore acl_user at the root directory?
by Fu-Ming_Tsai 24 Mar '05

24 Mar '05

Hello, I did something terrible. the acl_user at root directory are deleted. I can not access ZMI again!! However, there are many data I need!! Who can help me? :( --------------------------------------------- Fu-Ming Tsai Unit: ASCC, Academic Sinica E-mail address: sary357(a)gate.sinica.edu.tw

4 6

ZServer warnings
by Allen Schmidt 24 Mar '05

24 Mar '05

RH7.2 Python2.3.3 Zope2.7.2 and ZEO (sorry for the length) >From event.log: 2005-03-23T09:05:26 ERROR(200) ZServer uncaptured python exception, closing channel <ZServer.HTTPServer.zhttp_channel connected 206.112.73.106:42396 at 0x4421566c channel#: 95 requests:> (socket.error:(104, 'Connection reset by peer') [/usr/local/lib/python2.3/asynchat.py|initiate_send|218] [/var/www/zope/zope272c1/lib/python/ZServer/medusa/http_server.py|send|417] [/usr/local/lib/python2.3/asyncore.py|send|337]) [root@sws003 log]# tail -n100 event.log ------ 2005-03-23T09:16:20 PROBLEM(100) ZServer warning: server accept() threw an exception ------ 2005-03-23T09:16:20 PROBLEM(100) ZServer warning: server accept() threw an exception ------ 2005-03-23T09:16:20 PROBLEM(100) ZServer warning: server accept() threw an exception ------ 2005-03-23T09:16:20 PROBLEM(100) ZServer warning: server accept() threw an exception ... ... ... DeadLockDebugger shows this in several threads calling normal methods or images: File "/var/www/zope/zope272c1/lib/python/ZServer/PubCore/ZServerPublisher.py", line 23, in __init__ response=response) File "/var/www/zope/zope272c1/lib/python/ZPublisher/Publish.py", line 389, in publish_module environ, debug, request, response) File "/var/www/zope/zope272c1/lib/python/ZPublisher/Publish.py", line 180, in publish_module_standard response = publish(request, module_name, after_list, debug=debug) File "/var/www/zope/zope272c1/lib/python/ZPublisher/Publish.py", line 131, in publish sys.exc_info()[2], File "/var/www/zope/zope272c1/lib/python/Zope/App/startup.py", line 179, in zpublisher_exception_hook published=app.__bobo_traverse__(REQUEST).__of__( File "/var/www/zope/zope272c1/lib/python/ZODB/ZApplication.py", line 48, in __bobo_traverse__ conn=db.open(version) File "/var/www/zope/zope272c1/lib/python/ZODB/DB.py", line 493, in open force, waitflag) File "/var/www/zope/zope272c1/lib/python/ZODB/DB.py", line 493, in open force, waitflag) ... ... ... several hundred lines later... File "/var/www/zope/zope272c1/lib/python/ZODB/DB.py", line 493, in open force, waitflag) File "/var/www/zope/zope272c1/lib/python/ZODB/DB.py", line 465, in open pool_lock.acquire() Then this in another DeadLockDebugger thread: (included because it refers to asyncore.py at the end) Thread 2050 (GET /VirtualHostBase/http/www.fredericksburg.com:80//VirtualHostRoot/flshome/): File "/var/www/zope/zope272c2/lib/python/ZServer/PubCore/ZServerPublisher.py", line 23, in __init__ response=response) File "/var/www/zope/zope272c2/lib/python/ZPublisher/Publish.py", line 389, in publish_module environ, debug, request, response) File "/var/www/zope/zope272c2/lib/python/ZPublisher/Publish.py", line 180, in publish_module_standard response = publish(request, module_name, after_list, debug=debug) File "/var/www/zope/zope272c2/lib/python/ZPublisher/Publish.py", line 101, in publish request, bind=1) File "/var/www/zope/zope272c2/lib/python/ZPublisher/mapply.py", line 88, in mapply if debug is not None: return debug(object,args,context) File "/var/www/zope/zope272c2/lib/python/ZPublisher/Publish.py", line 39, in call_object result=apply(object,args) # Type s to step into published object. File "/var/www/zope/zope272c2/lib/python/OFS/DTMLMethod.py", line 130, in __call__ r=apply(HTML.__call__, (self, client, REQUEST), kw) File "/var/www/zope/zope272c2/lib/python/DocumentTemplate/DT_String.py", line 474, in __call__ try: result = render_blocks(self._v_blocks, md) File "/var/www/zope/zope272c2/lib/python/DocumentTemplate/DT_Var.py", line 214, in render val = md[name] File "/var/www/zope/zope272c2/lib/python/Shared/DC/Scripts/Bindings.py", line 320, in __render_with_namespace__ return self._bindAndExec((), namevals, namespace) File "/var/www/zope/zope272c2/lib/python/Shared/DC/Scripts/Bindings.py", line 343, in _bindAndExec return self._exec(bound_data, args, kw) File "/var/www/zope/zope272c2/lib/python/Products/PythonScripts/PythonScript.py", line 323, in _exec result = f(*args, **kw) File "Script (Python)", line 9, in breakingNews File "/var/www/zope/zope272c2/lib/python/Products/ZCatalog/ZCatalog.py", line 649, in searchResults return self._catalog.searchResults(REQUEST, used, **kw) File "/var/www/zope/zope272c2/lib/python/Products/ZCatalog/Catalog.py", line 753, in searchResults return self.search(args, sort_index, reverse, sort_limit, _merge) File "/var/www/zope/zope272c2/lib/python/Products/ZCatalog/Catalog.py", line 500, in search w, rs = weightedIntersection(rs, r) File "/var/www/zope/zope272c2/lib/python/ZODB/Connection.py", line 559, in setstate p, serial = self._storage.load(oid, self._version) File "/var/www/zope/ZOPECLIENT1/lib/python/ZEO/ClientStorage.py", line 749, in load p, s, v, pv, sv = self._server.zeoLoad(oid) File "/var/www/zope/ZOPECLIENT1/lib/python/ZEO/ServerStub.py", line 82, in zeoLoad return self.rpc.call('zeoLoad', oid) File "/var/www/zope/ZOPECLIENT1/lib/python/ZEO/zrpc/connection.py", line 367, in call r_flags, r_args = self.wait(msgid) File "/var/www/zope/ZOPECLIENT1/lib/python/ZEO/zrpc/connection.py", line 474, in wait asyncore.poll(delay, self._map) File "/usr/local/lib/python2.3/asyncore.py", line 108, in poll r, w, e = select.select(r, w, e, timeout)

3 5

RE: [Zope] acquisition
by Arenz, Ralph 24 Mar '05

24 Mar '05

On Mar 9, 2005, at 13:20, Arenz, Ralph wrote: > Hi, > > After upgrading from Zope-2.6.4 to Zope-2.7.3 i get the following error > when i try to add an object from the add-list in zmi: > > Unauthorized: You are not allowed to access '<property-name>' in this > context > (Also, an error occurred while attempting to render the standard error > message.) <Try your software on the current CVS Zope-2_7-branch and see if that <solves the problem. Some overeager security checks were fixed after <2.7.4. <jens I tried Zope-2.7.5-rc1 but the problem still exists! I can't get back to Zope-2.6.4 and i'am running in big trouble with that behaviour, because important elements won't be accessible for the many users. Of course i can change the factory-methods but in the end i'am not shure if there is a real bug or if there a common change in way container-properties are handled within factory-methods. ralph

6 16

Re: [Zope] manage_delObjects()
by Leticia Larrosa 24 Mar '05

24 Mar '05

Thanks for the answers, indeed the problem "was" outside the code. Thanks to all the community!! and to [Alexis, Chris, Dieter, -aj(Andreas Jung), Y. (Yuri)] Leticia -----Original Message----- From: "SER.RI-TIC-Alexis Roda" <alexis.roda(a)urv.net> To: Leticia Larrosa <LETICIA(a)tesla.cujae.edu.cu> Date: Thu, 24 Mar 2005 09:49:38 +0100 Subject: Re: [Zope] manage_delObjects() > Leticia Larrosa wrote: > > Thanks for all the answer but I try, for example whit: > > > > folderToDelete = 'toDelete' > > container.manage_delObjects([folderToDelete]) > > > > #or > > > > container.manage_delObjects([container[folderToDelete].getId()]) > > > > and get the following error in both cases: > > Error Type: KeyError > > Error Value: toDelete > > Seems like the object you're trying to delete don't exists (inside > container). In order to check this add (just before the > container.manage_delObjects()) something like: > > raise 'debug', container.objectIds() > > or > > raise 'debug', container.absolute_url() > > just to ensure that container is really what it should be and > 'toDelete' > is a subitem. > > > HTH > -- > //// > (@ @) > ----------------------------oOO----(_)----OOo-------------------------- > <> Ojo por ojo y el mundo acabara ciego > /\ Alexis Roda - Universitat Rovira i Virgili - Reus, Tarragona (Spain) > ----------------------------------------------------------------------- > > >

1 0

broken objects?
by Jürgen Herrmann 24 Mar '05

24 Mar '05

hi! after restarting zope i get broken objects, this seems to happen to my own extension classes only... the error msg is: "This object is broken because the unknown product that created it is no longer installed or is installed incorrectly. Please contact the product maintainer for assistance. Note that the data associated with this product has not been lost, and will be accessible again if the product is reinstalled." this raises a 'not found' with no further info in the traceback. the product seems to be installed fine though. as long as i don't restart my zope instance everything is fine, means i can reload products, update code, etc... anybody got some hints where i should start looking, googling for the error only brought back some mailinglist entries way back from ~2000... regards, juergen herrmann _______________________________________________________________________ >> XLhost.de - eXperts in Linux hosting << Juergen Herrmann Weiherweg 10, 93051 Regensburg, Germany Fon: +49 (0)700 XLHOSTDE [0700 95467833] Fax: +49 (0)721 151 463027 ICQ: 27139974 - IRC: #XLhost@quakenet WEB: http://www.XLhost.de

2 1

Re: [Zope] zForum problem
by Cliff Ford 24 Mar '05

24 Mar '05

Forgot to cc the list in the last reply. Line 142 of zForum.py says: CookieCrumbler.manage_addCC('cookie_authentication') and the error message is saying that it can't find manage_addCC in CookieCrumbler (I have taken out the rest of the Error log from this reply because it contained a plain text database connection string). Check that your Add dropdown list has Cookie Crumbler (Standalone) in its list and that the Zope user has read/write access to the CookieCrumbler and zForum folders. I have a test zForum installed and it just worked! If I create another with a dud database connection string I get a database error when trying to View (the installation appeared to work OK). Cliff H Jansen wrote: > Yep, that works. Here we go: > > Exception traceback > > Time > 2005/03/23 14:08:12.432 GMT+1 > User Name (User Id) > zope (zope) > Request URL > http://localhost:8080/mfts.nl/manage_addProduct/zForum/manage_addZForum > Exception Type > AttributeError > Exception Value > manage_addCC > > Traceback (innermost last): > > * Module ZPublisher.Publish, line 101, in publish > * Module ZPublisher.mapply, line 88, in mapply > * Module ZPublisher.Publish, line 39, in call_object > * Module Products.zForum.zForum, line 87, in manage_addZForum > * Module Products.zForum.zForum, line 116, in __init__ > * Module Products.zForum.zForum, line 142, in zfSetupSystem > AttributeError: manage_addCC > > ... snip ... > > On Wed, 2005-03-23 at 12:04, Cliff Ford wrote: > >>Look at the Error Log for the Traceback, which tells you exactly where >>the error occurred. That can often help pinpoint the problem by module >>and line number - look at the Product code if necessary. Include the >>Traceback in any question to the mailing list. >> >>Cliff >> >>burley(a)zonnet.nl wrote: >> >>>I've problems getting the zForum product working. When I try to create azForum >>>instance somewhere in my Zope site, I invariably obtain the errormessage: >>> >>>""" >>>Site ErrorAn error was encountered while publishing this resource. >>> >>>Error Type: AttributeError >>>Error Value: manage_addCC >>>""" >>>Looking for a solution on the internet, the closest I could get was >>>asdescribed in http://www.pcfltd.co.uk/docs/zforum.html (which is >>>aboutinstallation on a Windows machine; I'm working on Linux box). >>> >>>In the directory where I want to create the zForum: >>>1) I do have a database connection which is open en tested (works). >>>2) I do have a CookieCrumbler instance (which I'm not sure of whetherit's >>>essential or not...); the CookieCrubler properties are unchanged... (i.e. >>>__ac, __ac_name, __ac_password, etc) >>>3) In the zForum instance form I use the same connection string asdefined in >>>the database connection. >>> >>>The Site Error message keeps popping up all the time (...sigh). >>>Anyone some idea what's wrong...? >>> >>>

3 7

zForum problem
by burley＠zonnet.nl 24 Mar '05

24 Mar '05

I've problems getting the zForum product working. When I try to create azForum instance somewhere in my Zope site, I invariably obtain the errormessage: """ Site ErrorAn error was encountered while publishing this resource. Error Type: AttributeError Error Value: manage_addCC """ Looking for a solution on the internet, the closest I could get was asdescribed in http://www.pcfltd.co.uk/docs/zforum.html (which is aboutinstallation on a Windows machine; I'm working on Linux box). In the directory where I want to create the zForum: 1) I do have a database connection which is open en tested (works). 2) I do have a CookieCrumbler instance (which I'm not sure of whetherit's essential or not...); the CookieCrubler properties are unchanged... (i.e. __ac, __ac_name, __ac_password, etc) 3) In the zForum instance form I use the same connection string asdefined in the database connection. The Site Error message keeps popping up all the time (...sigh). Anyone some idea what's wrong...? -- _____________________________________________________________________ Versatel ADSL Gratis. De voordelen van gratis internet met de snelheid van ADSL. Zonder abonnementskosten en zonder vast contract. Je betaalt alleen voor de tijd online. Nu zonder aansluitkosten en met gratis modem. Bestel snel op www.versatel.nl.

5 5

XML from external server
by Robert Segall 24 Mar '05

24 Mar '05

Would appreciate your opinion: I have an external web server that replies to a certain request with an XML file, with a well defined structure. My goal is to have Zope pick up this file, and "do stuff" with it: perhaps return the HTML after applying an XSLT, or - ideally - access its contents (or parts of it) from some page template and/or DTML. The XML data (but not structure) may change quite often, independently of Zope, and I'd like these changes to be visible to the Zope clients, so it's not only a matter of storing the XML once. Anybody done anything like it? Hints? Tips? Gotchas? Examples? Products?!? -- Robert Segall Apsis GmbH Postfach, Uetikon am See, CH-8707 Tel: +41-44-920 4904

2 1