November 2002 - Zope-Dev

Re: [Zope-dev] Moving forward with Zope 2.7
by THoffman＠indtech.wa.gov.au 27 Nov '02

27 Nov '02

Hi Could we get the Install and Configuration proposal cleaned up, with so many comments it's not clear what the actual proposal proposes to deliver now. Also parts of it's problem statement are just plain wrong. I currently have many (read every version of Zope including Alpha's and Betas since 2.4.1b1) installed on the same box, and I have 18 instances of which at least 8 are running concurrently on our dev box, currently using at least 2 different versions of Zope (2.5.1 and 2.6.0). (Some of the non running instances if I started them up would be on 2.4.3 etc.. Currently we can do everything listed as a problem in the proposal, it is clean, neat and everything is in it's place. (except maybe item 5 in the problem statement) Regards Tim On Tue, 2002-11-26 at 04:12, Brian Lloyd wrote: > > Is there already a schedule for Zope 2.7? (of course there is not :-) ) > > Now there is :) > > http://dev.zope.org/Wikis/DevSite/Projects/Zope2.7/FrontPage > > I've updated this project and tried to dispel any lingering > confusion over the earlier effort labelled "Zope 2.7". > > > > I proposed to include reStructuredText into Zope 2.7. This stuff is > > ready to be merged. If there are no objections I will merge it soon > > since there were only positive votes for the inclusion. > > Please don't merge anything until people have had a chance to see > what's going on and gotten the plan finalized. > > Per the plan above, I'd like for there to be a (relatively short) period > for people to volunteer and add proposals to the plan, followed by a process > of prioritizing and coming to closure on what will / won't be included. I > propose in the wiki that we should probably schedule an IRC day to do that. > > > Brian Lloyd brian(a)zope.com > V.P. Engineering 540.361.1716 > Zope Corporation http://www.zope.com > > > > > _______________________________________________ > Zope-Dev maillist - Zope-Dev(a)zope.org > http://lists.zope.org/mailman/listinfo/zope-dev > ** No cross posts or HTML encoding! ** > (Related lists - > http://lists.zope.org/mailman/listinfo/zope-announce > http://lists.zope.org/mailman/listinfo/zope ) DISCLAIMER: This email, including any attachments, is intended only for use by the addressee(s) and may contain confidential and/or personal information and may also be the subject of legal privilege. Any personal information contained in this email is not to be used or disclosed for any purpose other than the purpose for which you have received it. If you are not the intended recipient, you must not disclose or use the information contained in it. In this case, please let me know by return email, delete the message permanently from your system and destroy any copies. Emails and their attachments may be interfered with, may contain computer viruses or other defects and may not be successfully replicated on other systems. All attachments are opened at the recipient's risk.

9 18

Re: [Zope] MailHost from 2.5.1 does not work in 2.6.0, was: Script from 2.5.1 does not work with 2.6.0
by Lennart Regebro 26 Nov '02

26 Nov '02

From: "Clemens Robbenhaar" <robbenhaar(a)espresto.com> > I guessed a little hint about this incompatibility in the release notes > would have been nice, but I can find nothing in this regard. I don't think anybody really was aware of it... :-/ It has to be fixed to 2.6.1 of course. The question is: Should the fix be to cast the smtp_port into an int every use (simple, functional, safe, ugly) or something else? > Did I miss some place to look at, or should the release notes possibly > be improved with respect to this? I checked some history. Up to 2.4 it was stored as an integer. For some reason it was changed between the final 2.5 beta and 2.5 release to be stored as a string, and then cast into an integer each time it was used. I don't know the rationale behind this change. However, the current MailHost is first appeared as a fix for several header problems I had already back in Zope 2.3, and this is probably why this change between 2.4 and 2.5 wasn't caught by the 2.6 MailHost. I based it on a 2.5 beta MailHost and must simply have missed this change, or at least not realized the effects of it.

2 1

Weird BTrees/ZODB interaction under Solaris
by Andreas Jung 26 Nov '02

26 Nov '02

I made the following reproducable observation running Zope 2.5 under Solaris: I was indexing a CMF site using TextIndexNG with about 1600 objects. During the commit phase (after all objects were indexed), the Zope process grow from about 100MB to more than 1.2GB. I could track this down to TextIndexNG. There is a function written in C that inserts the list of splittet words into the BTrees for the forward and reverse index (by generating the WordIDs internally). Replacing this method with a pure Python implementation made Zope behave fine. Torturing the corresponding C implementation in an isolated environment did not show any memory leaks (neither under Solaris nor under Linux i386). To make it short: my C implementation has three args: the forward index, the reverse index and a list of words to be inserted. The indexes are an OIBTree and an IOBTree. Internally I call PyObject_SetItem() to store the word-wid mapping. This seems to work fine isolated but seems to blow up the ZODB for unknown reasons. Note that his behaviour is only reproducable under Solaris. I made some tests by indexing about 100.000 docs under Linux with TextIndexNG and the Zope memory usage was very fine (up to 150MB). Cheers, Andreas --------------------------------------------------------------------- - Andreas Jung http://www.andreas-jung.com - - EMail: andreas at andreas-jung.com - - "Life is too short to (re)write parsers" - ---------------------------------------------------------------------

3 3

(Zope 2.6) Buglett in ZODB.ConflictResolution (missing import)
by Jo Meder 26 Nov '02

26 Nov '02

Just stumbled across a traceback in the logs that looks like a small bug in ZODB.ConflictResolution. In line 81 there's a reference to sys.exc_info() but sys is never imported in this module. Jo. -- Internetmanufaktur Jo Meder ---------------------- Berlin, Germany http://www.meder.de/ ------------------- fon: ++49-30-417 17 63 33 Kollwitzstr. 75 ------------------------ fax: ++49-30-417 17 63 45 10435 Berlin --------------------------- mob: ++49-170- 2 98 89 97 Public GnuPG-Key ---------- http://www.meder.de/keys/jo-pubkey.txt

1 0

Moving forward with Zope 2.7
by Brian Lloyd 25 Nov '02

25 Nov '02

> Is there already a schedule for Zope 2.7? (of course there is not :-) ) Now there is :) http://dev.zope.org/Wikis/DevSite/Projects/Zope2.7/FrontPage I've updated this project and tried to dispel any lingering confusion over the earlier effort labelled "Zope 2.7". > I proposed to include reStructuredText into Zope 2.7. This stuff is > ready to be merged. If there are no objections I will merge it soon > since there were only positive votes for the inclusion. Please don't merge anything until people have had a chance to see what's going on and gotten the plan finalized. Per the plan above, I'd like for there to be a (relatively short) period for people to volunteer and add proposals to the plan, followed by a process of prioritizing and coming to closure on what will / won't be included. I propose in the wiki that we should probably schedule an IRC day to do that. Brian Lloyd brian(a)zope.com V.P. Engineering 540.361.1716 Zope Corporation http://www.zope.com

2 1

vote
by Eva Rådahl 25 Nov '02

25 Nov '02

for my fantastic doughter Emma Rådahl to be Lucia (old tradition in Sweden on the 13th of december) of the town Uppsala in Sweden. You can vote for her if you go to www.unt.se/lucia and click on rösta (wich means vote) under the name Emma Rådahl (the last day to vote is 27 nov.) You can also lissen to her describing herself, but it is in Swedish. You can se 2 larger oicture of her if you go to <http://erlboden.cjb.net/> http://erlboden.cjb.net and a popup come up. Ther will also be lin to the site were you can vote. Thank you /Emmas mother.

1 0

KeywordIndex and PersistentList (Bug?)
by Thomas Guettler 25 Nov '02

25 Nov '02

Hi! In KeywordIndex the newKeywords get called if they are "callable": def _get_object_keywords(self,obj): newKeywords = getattr(obj, self.id, ()) if callable(newKeywords): # (*) newKeywords = newKeywords() if hasattr(newKeywords,'capitalize'): # is it string-like ? newKeywords = (newKeywords, ) return newKeywords This fails if the newKeywords are stored in a PersistentList. Callable is true, but there is no __call__ attribute. I changed the line marked with (*) to if hasattr(newKeyword, "__call__"): and this seems to work I think this does not break anything and could be included in the original. Am I the first how uses PersistentList for an indexed attribute? Is there a reason not to do so? thomas Please CC to me I am not on the list yet -- Thomas Guettler <guettli(a)thomas-guettler.de> http://www.thomas-guettler.de

6 7

consistent naming in ZEO releases
by Andrew Sydelko 25 Nov '02

25 Nov '02

Ok, whoever is in charge of zope.com releases of things like DCOracle2, Zope and ZEO need to decide if the release file names are going to end in .tar.gz or .tgz. The inconsistency between releases is quite annoying. I know that I've been hit by it both from DCOracle2 and ZEO. The actual Zope releases have at least been consistent. Sorry for the rant. --andy.

6 7

Security problems importing from python package.
by Clemens Robbenhaar 25 Nov '02

25 Nov '02

At Thu, 21 Nov 2002 12:16:09 +0000, Chris Withers wrote: > I'm trying to get stripogram working from Script(Pythons). I thought I had it, > but it appears I don't. > > I added the following in the __init__.py of the stripogram package: > > try: > from AccessControl import ModuleSecurityInfo,allow_module > except ImportError: > # no Zope around > raise > else: > allow_module('stripogram') > ModuleSecurityInfo('stripogram').declareObjectPublic() > ModuleSecurityInfo('stripogram').declarePublic('html2text', 'html2safehtml') > This issue is most probably resolved somewhere in between, but I can not find any trace of this at zope-dev(a)zope.org nor zope(a)zope.org, thus I drop in my 2 cents here. I did just now run into a similar problem, and may offer the following explanation after some debugging: It seems the 'allow_module', etc, gets not executed by Zope in advance, except if this is the __init__.py of a 'Product', or this module is imported by some core module or product. This is quite standard python behaviour; the module is not initialized before import, and Zope does some extra work to initialize all products on startup. If one tries to import the code from a python script, the security machinery first check, if the module has some security info, and imports it afterwards, if the info is found. But as the module is not imported anyway, it is not initialized, and has not such info and thus will not be allowed for import. It seems there is some chicken and egg problem here, or I have missed something completely. The workaround is to insert a dummy 'import stripogram' in some product, which triggers the security info creation -- or make the little helper scripts a product of its own. > I don't think either the allow_module or the declareObjectPublic() should be > necessary. However, the declareObjectPublic at least made this test pass: > > from Products.PythonScripts.PythonScript import PythonScript > theScript = PythonScript('test') > theScript.ZBindings_edit({}) > theScript.write("from stripogram import html2text\nreturn > html2text('<i>hello</i>')") > theScript._makeFunction() > self.assertEqual(theScript(),'hello') > This works, as Your test code imports something via file system (no access restriction) from module "stripogram" first and then creates the test script, which finds the module info on import as the module is intialized yet. > But even adding the 'allow_module' won't let the following Script (Python) > created through the ZMI work: > > from stripogram import html2text > > The error I get is: > > Error Type: ImportError > Error Value: import of "stripogram" is unauthorized In this case the module has not been initialized yet, and the TTW access is the first import, which failes due to the security restrictions problem mentioned above. Hope this helps; and hope someone can point me out I am wrong on the chicken and egg problem of 'non-Product' module import. Cheers, Clemens

2 1

Writing the second Zope Community Handbook
by Stephan Richter 25 Nov '02

25 Nov '02

Hello everyone, first of all, sorry for the cross-post, but I need to reach about everyone possibile in the Zope Community. While talking with Maik Roeder this weekend, we noticed that there might be a huge urge to write another community-authored Zope Handbook. So I called Nadja Rosmann, chief editor of Linux Enterprise magazine, today and talked to her. She was very excited about it and showed great interest. The first book we (the Zope community) wrote with them was a great success and started at Linux Enterprise an entire series of pocket books. The first book, which is also known as the Yellow Book, was a set of articles by various community members about Zope. The book was published in German and an English version was available online. The book covered a wide variety of subjects and offered a great alternative for people that were not willing to spend the money for a complete book, since the price was only 12.50 Euros. The book was therefore perfect for giving it to clients and other interested people without making a big investment. So, we plan to write a book like that again! This time however, we will publish the book on paper in at least German and English. I also talked to Nadja about a French version, since France seems to have some really cool Zope development going on. I truely believe that this book will help Paul's goal of having Zope grow 10x. BTW, since we will have many authors, I propose to donate the payments to a common Zope-oriented project, such as the creation of a Zope-booth or something else (the last donations went to the EuroZope e.V. for organizing conferences). Of course every author will receive a free copy in a preferred language. The next thing I need to discuss would be the topic of the book. Nadja and I agreed that it might be a better marketing argument, if we try to concentrate on Zope's Content Management capabilities. This way, many companies should be interested in writing about their products and case studies. What do you think? Now to the organization of the project. We need about 20-24 articles most having a length around 12k-20k characters (4-6 A4 pages) and some central articles having 20k-30k characters (about 10 A4 pages). This would produce a book with around 300 pages, which would be sold for 20.00 Euros. Since this is a community effort, people need to volunteer writing articles/chapters. Therefore, please E-mail me privately (so we do not cause huge cross-post threads), if you would like to write an article and what you would like to write the article about. Once I have enough responses, I will publish the list. Here are some points that might help thinking about a subject: - Do you or your company have developed your own Content Management System in Zope? Then tell us about it. Examples: CMF, Plone, Silva, Kontentor ... - Do you or your company have a client that you want the world to tell about? Why are you not writing a Case Study? Examples: Universities, Government agancies, other companies... - Do you have a product you developed (or extensively used) for Zope that you think should receive more attention or could be useful to many people? Right, write about it! Examples: Wikis, RDB Adapters, ZEO, I18n tools, Discussion Boards... - Do you know a particular thing about Zope that you particularly liked about Zope and that caused you using it? Please, tell us about it. Examples: RDB/LDAP Integration, User management, speed of development (RAD) ... - Are you developing some cool stuff for the Zope core? Write about it... - There is also some interest in having a couple reports on the progress of Zope 3, so if you are a Zope 3 developer, you might write an article comparing the differences between the Zope 2 and Zope 3 way of doing things. Examples: RDB Integration, Caching, I18n, Components versus Multi-talented objects... - If you do not know a topic, but still would like to write an article, contact me anyway and we will find a subject together. Also, we do not need only writers, but also translators. So, if people do not feel comfortable writing an entire article, they could also volunteer as translator. Now to the time frame. I think that it will be best to write the articles during Christmas, since it is a slow time and people have some more time on their hands. My ambitious goal is to send the complete set of scripts to Nadja by January 25th (Why that day? Because it is her and my birthday. ;-). This project cannot happen without the community! Please help us making this project a success! Regards, Stephan -- Stephan Richter CBU Physics & Chemistry (B.S.) / Tufts Physics (Ph.D. student) Web2k - Web Software Design, Development and Training

1 0