- Zope - Zope lists

Re: [Zope] How to export ZWiki contents in ZODB to MYSQL
by Win Myint Aung 27 Feb '07

27 Feb '07

Dear Tino, Thank you for your reply. Another big problem is I don't know how to start the python script. I would like to request any body to help me. Any draft script may be a good start for me. Thanks. ----- Original Message ---- From: Tino Wildenhain <tino(a)wildenhain.de> To: Win Myint Aung <wma108(a)yahoo.com> Cc: zope(a)zope.org Sent: Tuesday, February 27, 2007 1:12:39 PM Subject: Re: [Zope] How to export ZWiki contents in ZODB to MYSQL Win Myint Aung schrieb: > Dear Members, > > I am a newbie in Zope. please do me a favor. I am looking for some > python scripts that can export Zwiki contents from ZODB to MYSQL. Well, the script is easy in principle but you need to know how the result in your MySQL should look like. So its basically just traversing the object tree in zope, lookup the properties and attributes with content and then rewrite them in the form your application needs it. Otoh, its a lot of work - what is the expected gain? Regards T. ____________________________________________________________________________________ We won't tell. Get more on shows you hate to love (and love to hate): Yahoo! TV's Guilty Pleasures list. http://tv.yahoo.com/collections/265

1 0

How to export ZWiki contents in ZODB to MYSQL
by Win Myint Aung 27 Feb '07

27 Feb '07

Dear Members, I am a newbie in Zope. please do me a favor. I am looking for some python scripts that can export Zwiki contents from ZODB to MYSQL. Thanks. Aung ____________________________________________________________________________________ Bored stiff? Loosen up... Download and play hundreds of games for free on Yahoo! Games. http://games.yahoo.com/games/front

2 1

Dynamic class from python script (?)
by Dimitris Koukis 26 Feb '07

26 Feb '07

Dear Zopistas, i have an old zope application that present data from a database in such a manner <dtml-in "sql_methods.select_user()"> <dtml-var firstname><dtml-var lastname> </dtml-in> I had to change the methods that returned data from the database, and it is no longer possible to return data directly from zsql methods. Instead i read them in a script, perform some processing and return a dictionary with exactly the same mappings. I thought the application would work without any change but it seems this is not the case (variables in dtml-in can not be found, kinda makes sense now, the dictionary values are not properties...). So i created class that dynamically contain all data returned from my script. The class is something like this class foo: dct ={} def fill(self,temp_dct): self.dct = temp_dct def __getattr__(self,val): return self.dct[cal] >From pure python it works fine. Unfortunately i can not use it in a zope python script because of the __getattr__ method, so i put the class definition in an external method and use it in the python script (it returns an instance of the class). But dtml still returns me some strange errors. First, when the instance is created/accessed, some zope-like methods are called on it (for example getId, cant figure out why), and even if i implement them (dummy) it returns me authorization errors. Any idea, or alternative solution would be more than helpful ;) My main objective is not to change the zope application Thank you.... PS sorry for the length of my mail, but it is kinda complicated problem :) -- Dimitris Koukis Software Engineer koukis(a)vtrip.net

2 2

Moodle and Zope SSO.
by Jose Luis de la Rosa Triviño 26 Feb '07

26 Feb '07

Hello all, I need to implement a SSO solution for Moodle and Zope. My use case is: 1. The user logs in Zope. 2. Zope logs in Moodle (in behalf of the user) and forwards the authentication cookie to the client. I suppose that the user has the same credentials in Zope and Moodle. I'm trying to implement a script like the one shown below but it seems too tricky and it does not work. Has anybody implemented this kind of sso with zope and moodle or whatever? Thank you very much! My script now looks like this: URL_AUTH = 'http://localhost/moodle/login/index.php' params = {'username':'foo', 'password':'bar'} conn = urllib2.urlopen(URL_AUTH, urlencode(params)) mycookie = conn.info().getheaders('Set-Cookie')[-1] # Get the cookie MOODLEID_ name = mycookie[0: int(mycookie.find("="))] # Get the name value = mycookie[mycookie.find("=")+1: mycookie.find(";")] # The value self.REQUEST.RESPONSE.setCookie(name, value, path='/moodle', domain='localhost') self.REQUEST.RESPONSE.redirect("http://localhost/moodle")

3 3

zope unresponsive
by Paul Williams 26 Feb '07

26 Feb '07

I know that there is a switch between zeo and zope and probably a firewall too, but how do I prove this is the problem. This is on production server in a military installation. I have major problems getting any kind of trouble shooting support. First we don't get access, and second no kind of debugging is allowed. You couldn't imagine the paperwork and the three months it took for me to get deadlockdebugger installed. Thanks, Paul

2 1

How can I import this module in python script ?????
by ian＠inpa.gov.br 26 Feb '07

26 Feb '07

Hi, I am playing around trying to make something happen on a workflow state change. Beacause I cannot import the module I need in the python script I am getting an error: global name 'getMemberById' is not defined how can I import this module or better still code this so I am not importing anything at all (i imagine the restrictions on importing modules was done for a reason). #import the module we need from Products.CMFCore.utils import getToolByName # Get the content object we're publishing review_state.object # How can I import this module????? #from Products.CMFDefault.MembershipTool import MembershipTool mt = getToolByName(context, 'portal_membership') listed_ids = mt.getRoster() contentObject = review_state # Start with an empty list, ready to be filled with the addressed # of people we're dispatching to mailList=[] mailhost = context.MailHost mailhost = getattr(context, 'MailHost', None) # Iterate through all the site's users # context.portal_membership.listMembers(): for id in listed_ids: member = getMemberById(id) email = member.getProperty('email') # add them to the list of people we're emailing mailList.append(email) mMsg = 'Crop notification sent' mTo = email # and send it mailhost.send(mMsg, mTo, 'someone(a)somewhere.com', 'New Crops available') # The change in indentation signals the end of the loop, so we've # now sent all the emails. Let's now send a confirmation that we've done it. # We'll be building the email as a string again, but we have to convert our # list data elements into a string before we can append the information recipients = string.join(mailList) mMsg = 'These people were sent e-mails' #mMsg += contentObject.absolute_url() + mMsg += recipients mailhost.send(mMsg, 'someone(a)somewhere.com', 'someone(a)somewhere.com', 'Lizard Leaves Announcement email confirmation') thx []'s Ian F U cn rd dis U mst uz Linux.

3 2

Large jumps of memory use increase, and seeking overall understanding of memory use
by Jean Lagarde 26 Feb '07

26 Feb '07

All, (I am posting to both the general Zope and Plone lists, I hope that's all right. My questions are more directly Zope issues, but in case someone who only looks only at the Plone lists has a different insight to offer...) I'm the co-admin Alex Kirk was referring to in his recent post "Random Crashes/Freezes on FreeBSD 5.4-RELEASE" on the Zope list. The particular instance he was referring to was not a "random" crash but simply Zope running out of memory (with the standard 512M limit on FreeBSD, that we have not increased so far -- we have 2Gb of physical memory). I have had one truly unexplained unresponsive Zope on that system so far, but was not able to characterize it well enough to ask an intelligent question on the list about that one. I fully understand that Zope has to be restarted regularly and intend to use monit to do so, but I would like to better understand what is going on in any case, and hopefully be able to lower the required frequency of such restarts. I have searched the lists (posts like "[Zope-dev] Very severe memory leak" and "[ plone.user] Memory leaks even with latest-everything minimalistic site?") and get the general idea, but what I have read so far does not directly explain what I am observing. I have a test machine, but for starters, I have done some analysis of memory consumption of our live site to see what normal traffic produces. I have used a script to capture the size of the Zope process every minute (from ps) and merged these results with the access log. What I see does not make sense to me in terms of object cache, or growth of refcounts. My only (entirely unverified) hypothesis is that modules like PIL grab large chunks of memory once in a while. I provide specific examples below. First, the system: Plone 2.5.1, CMF-1.6.2, Zope (Zope 2.9.5-final, python 2.4.3, freebsd5), Five 1.3.7, Python 2.4.3 (#2, Jul 2 2006, 16:14:54) [GCC 3.4.2 [FreeBSD] 20040728], PIL 1.1.5 FreeBSD 5.4 My object cache size was initially at the default of 5000 objects per threads (4 threads default). I reduced this to 2000 just to see, but as I expected, the overall memory use behavior was the same. I have made some minor customizations to Plone and added contributed as well as my own products. My use of CMFReportTool might explain some of what I see, but definitely not all. Overall, my custom memory-use/access-log shows long periods with no increase in memory at all, but there are some big jumps at times (during a one minute tick) by 5, 10, even 25 Mb! As pretty much expected, Zope never gives much memory back to the OS; that part I understand, however I would like to get it to a state where it mostly plateaus and then only slowly creeps up. Some specific examples: With memory use at 417640 Kb, no requests at all in the previous minute, and a single request for an image_view_fullscreen in that whole minute, memory use jumped by 5064 Kb to 422704. The image was definitely not that large! (access log shows size returned was 1137). While on that topic, I realize that the ATImage has to be loaded in the object cache at some point, and that if it's a large image (in the order of mega bytes), I might see the memory use jump by that much. Now assume that the cache was already full when the image was loaded, that a lot of other later requests fill the cache with much smaller objects (so the image is not cached anymore) and then later the image is requested again, my guess is that the cache should already have the space it needs to load it, i.e. should I expect to see another memory jump by the size of the image, and if so, why (where did the space it originally occupy go that it can't be reused)? Can I easily check if large objects are being split in smaller chunks as they should by the way? Other example: A few of the large jumps I noticed have as one of the request during that minute a PDF listing of some documents. I use CMFReportTool to generate the PDF. There seems to be a possible correlation there, however, the resulting PDF document is about 150K, and these memory jumps can be as large as 10 Mb! I'll have a look at my code, CMFReportTool's and ReportLab's, but that seems a bit excessive to produce that document, so I wonder if something else is going on there. Of course, there is a catalog query required to get the documents to list, but I generate the report with the metadata only ( i.e. so nothing should be loaded in the object cache). I expect some increase in memory the first time a module is loaded (like ReportLab, although doesn't that happen when Zope is launched as part of product initialization?), but that would not explain continued increases on further requests. There are also many cases where the same listing was requested with no increase in memory at all (although that may be due to caching -- I'll have to look into that; I use cacheFu but have turned Squid off for now). Other example: There are however cases where I just can't see any reason for the sudden jumps. In one case there was a ~15M increase (from 477996 to 493016) during a one minute tick, with only a few very benign requests (GETs for the sento_form, contact-info form, and a couple of very small ATDocuments. There were no memory increases for the two minutes preceding and following that occurrence. Yet another: There was a 27Mb increase in one minute (the largest during that log), nowhere close to a Zope restart (the memory use was at 374376 prior to the jump). In that case there were a lot of requests in the preceding minute, but they all look benign to me (a few image thumbs, css, js, gifs; looks as if someone did a force reload of their browser). Of course the images had to be loaded to produce the thumbs, but I am sure that they total nowhere close to 27 Mb (they were all already pretty much thumb size to start with, except our "image of the day", which might have been a couple of Mb). Is the PIL process of generating the thumbs that memory hungry? I hope not. I have also noticed a few instances where there are no requests for a few minutes but still some growth of the Zope process (not by much though). I assume that these are due to Zope internal housekeeping? I do have an automated process that loads some content, but it runs at a fixed time in the night and I have not seen large memory jumps while that runs. If someone feels like having a look, for fun ;-), that memory-use/access-log file I have been looking at is a 6 Mb HTML file (I removed some info from the access entries so they are easier to scan through, and show the memory increases/decreases as a bar graph so it's easy to scroll down the file and see big changes). The log spans one Zope restart (I see a couple big and then more little memory jumps soon after Zope has started, which makes sense to me). Other tidbits. I have seen one post stating that large file imports may increase memory use by 2 to 3 times the size of the file. I have looked at some POSTs of large images and see about that. Are these increases cumulative, or should they plateau at some point? Also it wasn't clear in that post if that was supposed to be a WebDav issue only (we are not using WebDav so far). When I flush the cache, the DateTime refcount goes down dramatically, but the top counts (ValidationChain, EmptyValidator, AttributeStorage, StringField) do not go down significantly. Alex and I are volunteers doing this work for a non-profit, so any ideas or "yep, that's normal, live with it" would be greatly appreciated! (If the latter answer, I would still like to better understand where that memory is being used; I still don't understand how it could be the object cache, which is often cited as the main cause of memory creep). Cheers, Jean

4 18

Error Value: 'Set' object has no attribute 'count'
by kjcsb 25 Feb '07

25 Feb '07

I am getting an error message when Zope is trying to evaluate the following: elif string.count(product_info['product']['options'],'lookup') == 1: The error message is: Error Value: 'Set' object has no attribute 'count' I have two instances of Zope running. On Zope 2.8.2-final, python 2.3.5, linux2, this does not occur. On Zope 2.8.7-1.el4.rf, python 2.3.4, linux2, it does occur. Could anyone suggest a solution? Thanks and regards Cameron

4 3

Running ./zopectl gives NameError: name 'set' is not defined
by michael nt milne 24 Feb '07

24 Feb '07

Hi On trying to make a new zopeinstance from a Plone 2.5 instance created using the unified installer I am getting the following error when I attempt to run ./zopectl and start the instance. Traceback (most recent call last): File "/opt/Plone-2.5/lib/python/Zope2/Startup/run.py", line 56, in ? run() File "/opt/Plone-2.5/lib/python/Zope2/Startup/run.py", line 19, in run opts = _setconfig() File "/opt/Plone-2.5/lib/python/Zope2/Startup/run.py", line 48, in _setconfig opts.realize(doc="Sorry, no option docs yet.") File "/opt/Plone-2.5/lib/python/zdaemon/zdoptions.py", line 273, in realize self.load_schema() File "/opt/Plone-2.5/lib/python/zdaemon/zdoptions.py", line 321, in load_schema self.schema = ZConfig.loadSchema(self.schemafile) File "/opt/Plone-2.5/lib/python/ZConfig/loader.py", line 31, in loadSchema return SchemaLoader().loadURL(url) File "/opt/Plone-2.5/lib/python/ZConfig/loader.py", line 65, in loadURL return self.loadResource(r) File "/opt/Plone-2.5/lib/python/ZConfig/loader.py", line 159, in loadResource schema = ZConfig.schema.parseResource(resource, self) File "/opt/Plone-2.5/lib/python/ZConfig/schema.py", line 27, in parseResource xml.sax.parse(resource.file, parser) File "/usr/local/lib/python2.3/xml/sax/__init__.py", line 33, in parse parser.parse(source) File "/usr/local/lib/python2.3/xml/sax/expatreader.py", line 107, in parse xmlreader.IncrementalParser.parse(self, source) File "/usr/local/lib/python2.3/xml/sax/xmlreader.py", line 123, in parse self.feed(buffer) File "/usr/local/lib/python2.3/xml/sax/expatreader.py", line 207, in feed self._parser.Parse(data, isFinal) File "/usr/local/lib/python2.3/xml/sax/expatreader.py", line 300, in start_element self._cont_handler.startElement(name, AttributesImpl(attrs)) File "/opt/Plone-2.5/lib/python/ZConfig/schema.py", line 99, in startElement getattr(self, "start_" + name)(attrs) File "/opt/Plone-2.5/lib/python/ZConfig/schema.py", line 475, in start_schema keytype, valuetype, datatype = self.get_sect_typeinfo(attrs) File "/opt/Plone-2.5/lib/python/ZConfig/schema.py", line 201, in get_sect_typeinfo datatype = self.get_datatype(attrs, "datatype", "null", base) File "/opt/Plone-2.5/lib/python/ZConfig/schema.py", line 194, in get_datatype return self._registry.get(dtname) File "/opt/Plone-2.5/lib/python/ZConfig/datatypes.py", line 398, in get t = self.search(name) File "/opt/Plone-2.5/lib/python/ZConfig/datatypes.py", line 423, in search package = __import__(n, g, g, component) File "/opt/Plone-2.5/lib/python/Zope2/Startup/datatypes.py", line 21, in ? import OFS.Uninstalled File "/opt/Plone-2.5/lib/python/OFS/Uninstalled.py", line 20, in ? import SimpleItem, Globals, Acquisition File "/opt/Plone-2.5/lib/python/OFS/SimpleItem.py", line 26, in ? import AccessControl.Role, AccessControl.Owned, App.Common File "/opt/Plone-2.5/lib/python/AccessControl/__init__.py", line 17, in ? from Implementation import setImplementation File "/opt/Plone-2.5/lib/python/AccessControl/Implementation.py", line 98, in ? setImplementation("C") File "/opt/Plone-2.5/lib/python/AccessControl/Implementation.py", line 51, in setImplementation from AccessControl import ImplC as impl File "/opt/Plone-2.5/lib/python/AccessControl/ImplC.py", line 18, in ? from cAccessControl import rolesForPermissionOn, \ File "/opt/Plone-2.5/lib/python/AccessControl/SimpleObjectPolicies.py", line 82, in ? from DocumentTemplate.DT_Util import TemplateDict File "/opt/Plone-2.5/lib/python/DocumentTemplate/__init__.py", line 21, in ? from DocumentTemplate import String, File, HTML, HTMLDefault, HTMLFile File "/opt/Plone-2.5/lib/python/DocumentTemplate/DocumentTemplate.py", line 112, in ? from DT_String import String, File File "/opt/Plone-2.5/lib/python/DocumentTemplate/DT_String.py", line 19, in ? from DT_Util import ParseError, InstanceDict, TemplateDict, render_blocks, str File "/opt/Plone-2.5/lib/python/DocumentTemplate/DT_Util.py", line 67, in ? from ZPublisher.TaintedString import TaintedString File "/opt/Plone-2.5/lib/python/ZPublisher/__init__.py", line 24, in ? from Publish import publish_module, Retry File "/opt/Plone-2.5/lib/python/ZPublisher/Publish.py", line 20, in ? from Request import Request File "/opt/Plone-2.5/lib/python/ZPublisher/Request.py", line 13, in ? import HTTPRequest File "/opt/Plone-2.5/lib/python/ZPublisher/HTTPRequest.py", line 18, in ? from BaseRequest import BaseRequest File "/opt/Plone-2.5/lib/python/ZPublisher/BaseRequest.py", line 583, in ? itypes[set] = 0 NameError: name 'set' is not defined Thanks -- michael

2 1

Problems receiving mails from the list
by Garito 24 Feb '07

24 Feb '07

Hi all! The zope list don't work properly for me for 2 days ago with my normal account garito(a)sistes.net I send several messages (as you could see here: http://tech.groups.yahoo.com/group/zope/message/166174 and here: http://tech.groups.yahoo.com/group/zope/message/166152) but both were lost for me (don't came back to my box) I try to send some message to ask at zope-owner(a)zope.org and jim(a)zope.orgbut nothing in response Could anyone help me, please? And what do you think about my original question? Thanks and sorry if these message are repeated for you! -- Mis Cosas: http://blogs.sistes.net/Garito

3 2