April 2004 - Zope-Dev

Re: [ZODB-Dev] Re: BTrees strangeness (was [Zope-dev] Zope 2.X BIG Session problems - blocker - our site dies - need help of experience Zope developer, please)
by alex＠halogen-dg.com 19 May '04

19 May '04

Hi Chris, On Wed, 3 Mar 2004, Chris McDonough wrote: > With this text: > > <zodb_db temporary> > # Temporary storage database (for sessions) > <filestorage> > path $INSTANCE/var/Sessions.fs > </filestorage> > mount-point /temp_folder > container-class Products.TemporaryFolder.TemporaryContainer > </zodb_db> Installed. I had to install new zope instance first, then import old content via zexp & recreate manually all admins. Because when you change the running zope config in Zope 2.7.0 it has no impact on temp_folder - Sessions.fs is not created when the temporary storage was already in place. Lets see, next test will be on Monday, many users come only on working days. I also got many complatins from customer, so I wrote a test suite which is logging to a site each 2 minutes, and if there are problem, it sends emails to all of admins, so they come and restart zope. With prev. Transience, when this keyError appear, it was seen only by 1,2,3 users. With new Transience, when error starts to appear, nobody is able to see any page which uses Session - all sessions became broken. I am monitoring site now, and will tell you about the results. -- Alex V. Koval http://www.halogen-dg.com/ http://www.zwarehouse.org/

15 68

Zope 2.6.X, 2.7.x sesssion problems, please help (fwd)
by alex＠halogen-dg.com 14 May '04

14 May '04

I see Chris post at: http://mail.zope.org/pipermail/zope-dev/2003-March/019116.html As far I see, this bug still existing in Zope 2.6.4, Zope 2.7.0. Its strange because into Changes histore of Zope it seems to be fixed into 2.6.2: Zope 2.6.2 beta 2 Bugs Fixed * TemporaryStorage (which is used by TemporaryFolder, and thus the default sessioning configuration) no longer uses a "LowConflictConnection" database connection. This fixes a bug in which data structures used for session housekeeping data could become desynchronized; the symptom for this was KeyErrors being raised from TransientObjectContainer's get method. As a result, many more conflicts will be raised under high session load, but desynchronization will not occur. Could you please at least point me where I can dig to get it fixed? I will try to read Python code in Transience.Transience but I am not sure in my qualification in this area. Bug reported at zope.org as: http://zope.org/Collectors/Zope/848 but until now there were no comments which help me to fix this. may be something needs to be changed into my code? in the beginning of many scripts I have the following: request=container.REQUEST session=request.SESSION please give me a hint. Thanks. -- Alex V. Koval http://www.halogen-dg.com/ http://www.zwarehouse.org/

12 37

ATTENTION! cvs to subversion transition tomorrow
by Jim Fulton 12 May '04

12 May '04

Tomorrow, as planned. I'm going to move the main development branches for Zope 2, Zope 3, and ZODB to subversion. I will start the move at 10am US/Eastern time tomorrow. I plan to be done before 5pm US/Eastern time. During this time, I ask that no one make checkins to the CVS head for those projects. The first thing I will do is to tag the head with the tag: 'cvs-to-svn-conversion'. When I'm done, I will remove all files from the heads of the preojects in CVS, except README.txt files giving subversion access instructions. Speaking of subversion instructions, I'll be sending some later today. If you want to do writable subversion checkouts, you'll need to submit a version 1.1 contributor's agreement (if you haven't already). The contributor's agreement can be found at: http://dev.zope.org/DevHome/CVS/Contributor.pdf You can print and then send the filled out and signed agreement to us in one of 3 ways: - Ordinary mail to: Zope Corporation, 513 Prince Edward Street Fredericksburg, VA, USA, 22401 - Fax to 1.703.995.0412 - Email a scanned form to: jim(a)zope.com Jim -- Jim Fulton mailto:jim@zope.com Python Powered! CTO (540) 361-1714 http://www.python.org Zope Corporation http://www.zope.com http://www.zope.org

12 40

Bug day report
by Casey Duncan 10 May '04

10 May '04

I'm happy to report a successful bug day with a final tally of almost 40 issues closed. The specific issues we squashed were: #28,#181,#321,#340,#349,#439,#444,#495,#511,#532,#540,#543, #544,#545,#546,#553,#562,#574,#584,#602,#637,#644,#654,#658,#666, #678,#724,#800,#810,#811,#875,#1003,#1042,#1050,#1148,#1227,#1298, #1300. Thanks to all who participated! -Casey

8 18

[Collector] Strange reject policy
by Dieter Maurer 07 May '04

07 May '04

I got a reject message for "http://collector.zope.org/Zope/444" with the comment: ZClasses are not being actively maintained, so unless you provide a patch, it is not likely to be fixed. I see this as a strange reject policy. In my view, bug reports in the collector should only be rejected when they are not bugs or when they can not longer occur. We want that people with strange effects look into the collector to find out whether this is a known problem, don't we? Rejected bug reports are much more difficult to find than open ones. In this case, the issue reports a true bug which pose a potential security risk because a permission mapping unexpectedly has no effect. I do not argue that this bug needs a fix but the report should at least be easily found. -- Dieter

11 28

The bleak Future of Zope?!
by kretschmar＠infoman.de 07 May '04

07 May '04

Hello, Maik Jablonski of the german speaking Zope Users Group DZUG issued a pretty bleak outlook for the future of Zope. What are your oppinions? Here comes the translation of his oppoion: > Maik, what makes you look full of scepticism for > the future of Zope? Shortly said, the whole set of stupidities in connection with Zope3. It is a pretty bad state for a project, if it looms for years as the followup project on the horizon but in reality isn't one! I can't believe the fairy tales with the possible migration from Zope2 to Zope3. All the people which have dwelled more or less deeply into the Zope2 world, thereby having had an enormous learning curve and now running applications, will not be able to participate easily on the academic Zope3 train. The technic freaks who modell Zope3 are usually not application developers, which have to build and run working applications for real human users. The artifical not-yet-product Zope3 will sooner or later be distracting development efforts from Zope2 because Zope3 is "almost finished." That doesn't look not nice ... Further I see the problem that Zope probably has no real target group as an application server. The enterprise world is dominated by .Net and J2EE. Zope in its current form without a sensible documentation in conjunction with the drama about the english zope book doesn't help changing this. Scripting has arrived in the Java world by Groovy, so this isn't a reason for using Zope anymore. In the world of small and medium applications PHP is likely to stay, because it leads much faster to results. Zope is to complicated for this. For the CMS stuff we have Plone, but this is rather suited for handling some simplistic documents for the intranet rather then a nice internet representation. This is because customizing Plone isn't trivial at all and nobody want's to run web pages with standard underwear blue. OK, the colours can be changed easily, other features via CSS, etc. ... Maybe I'm simply sick of moving along within web browsers and the file system without a sensible IDE and documentation. Regards, Maik

34 90

Change in repository approach to software sharing
by Jim Fulton 07 May '04

07 May '04

The Zope project includes a number of interrelated subprojects, such as: - Zope 2 - Zope 3 - ZODB - ZConfig Software from the ZODB and ZConfig projects are shared by Zope 2 and Zope 3. We want this sharing to be very convenient for people working on Zope 2 and Zope 3. We don't want users of the Zope 2 and Zope 3 repository to have to do separate checkouts for ZODB and ZConfig. CVS supports such software sharing through it's "module" system. The module system has some flaws, so we use symbolic links instead. In a response to: http://dev.zope.org/Zope3/MovingSCMToSubversion John Belmonte has suggested that Zope 2 and Zope 3 should depend on specific versions of shared packages, rather than on the head. I'm inclined to agree. People working on ZODB and ZConfig have to test their changes against both Zope 2 and Zope 3 to avoid breakage. This is very burdensome and causes much pain when they get it wrong. Fortunately, subversion provides a mechanism for sharing specific revisions. We'll be able to have the convenience of getting ZODB and ZConfig (and other shared software) when we do a checkout *and* we'll be able to control what parts we get. To see how this will work, we'll look at ZConfig as an example (because it has a single package) of reusable software that we will include in Zope 3. In the repository, we'll have a top-level Zope3 project directory, with the standard svn subdirectories "trunk", "branches", and "tags". We'll also have a top-level ZConfig project directory. The "trunk" of the ZConfig Python package will be in ZConfig/trunk/src/ZConfig. If we create a tag T1 of ZConfig, then the Python package for that tag will be in ZConfig/tags/T1/src/ZConfig. Now, when we set up the Zope 3 repository, we will create the ZConfig package in Zope 3 by copying a *tag* from the ZConfig project: svn copy svn+ssh://svn.zope.org/repos/ZConfig/tags/T1/src/ZConfig \ svn+ssh://svn.zope.org/repos/Zope3/trunk/src/ZConfig -m 'Bring ZConfig T1 into main branch' Then, whenever someone checks out the Z3 trunk, they'll get the ZConfig from T1. If we need to, we can even make Zope3-local changes to ZConfig. Later, we may decide to upgrade the Zope 3 head to use ZConfig tag 3. At that point, we can recopy from the tag, or we can merge changes made between the two tags. A similar technique can be used for external software, as described in: http://svnbook.red-bean.com/svnbook/ch07s04.html Jim -- Jim Fulton mailto:jim@zope.com Python Powered! CTO (540) 361-1714 http://www.python.org Zope Corporation http://www.zope.com http://www.zope.org

3 5

Weird "couldn't load state" on Zope 2.6.2
by Chris Withers 06 May '04

06 May '04

Hi there, When I click on the Advanced tab of one of my ZSQL Methods, I see this: Traceback (innermost last): Module ZPublisher.Publish, line 98, in publish Module ZPublisher.mapply, line 88, in mapply Module ZPublisher.Publish, line 39, in call_object Module Shared.DC.Scripts.Bindings, line 252, in __call__ Module Shared.DC.Scripts.Bindings, line 283, in _bindAndExec Module App.special_dtml, line 174, in _exec Module Shared.DC.ZRDB.DA, line 485, in manage_product_zclass_info Module ZODB.Connection, line 554, in setstate Module ZODB.Connection, line 590, in _set_ghost_state Module ZODB.Connection, line 210, in _persistent_load - __traceback_info__: XXXXXXdF Module ZODB.Connection, line 149, in __getitem__ - __traceback_info__: ('\x00\x00\x00\x00\x00\x08dF', '(cExtensionClass\nExtensionClass\nq\x01(U\x1dToDoClass_PropertySheetsClassq\x02(cZClasses.ZClass\nPersistentClass\nq\x03cProducts.ZPatterns.PropertySheets\nVirtualSheets\nq\x04cZClasses.Property\nZInstanceSheets\nq\x05tq\x06}q\x07(U\x04iconq\x08U\x00U\n_p_changedq\tK\x01U\x07__doc__q\nU\x19ToDoClass Property Sheetsq\x0bU\x11__propset_attrs__q\x0c(U\x05Basicq\rtq\x0eU\x05Basicq\x0f(U\x08\x00\x00\x00\x00\x00\x08d\\q\x10(U\x11ZClasses.Propertyq\x11U\x0eZInstanceSheetq\x12tq\x13tq\x14QU\x06_p_oidq\x15U\x08\x00\x00\x00\x00\x00\x002nq\x16U\n__module__q\x17NU\t_p_serialq\x18U\x08\x038;\xa2\xb7n[\xb3q\x19utq\x1at.N.') Could not load oid XXXXXXdF, pickled data in traceback info may contain clues. Where the XXXXXX in XXXXXXdF are what my mailer is substituting for unprintable characters. And in in the event log I see: 2004-04-25T18:42:43 ERROR(200) ZODB Couldn't load state for '\x00\x00\x00\x00\x0 0\x08d>' Traceback (innermost last): File E:\Zope\2.6.2\lib\python\ZODB\Connection.py, line 554, in setstate File E:\Zope\2.6.2\lib\python\ZODB\Connection.py, line 590, in _set_ghost_stat e File E:\Zope\2.6.2\lib\python\ZODB\Connection.py, line 210, in _persistent_loa d (Info: dF) File E:\Zope\2.6.2\lib\python\ZODB\Connection.py, line 149, in __getitem__ (Info: ('\x00\x00\x00\x00\x00\x08dF', '(cExtensionClass\nExtensionClass\nq\x 01(U\x1dToDoClass_PropertySheetsClassq\x02(cZClasses.ZClass\nPersistentClass\nq\ x03cProducts.ZPatterns.PropertySheets\nVirtualSheets\nq\x04cZClasses.Property\nZ InstanceSheets\nq\x05tq\x06}q\x07(U\x04iconq\x08U\x00U\n_p_changedq\tK\x01U\x07_ _doc__q\nU\x19ToDoClass Property Sheetsq\x0bU\x11__propset_attrs__q\x0c(U\x05Bas icq\rtq\x0eU\x05Basicq\x0f(U\x08\x00\x00\x00\x00\x00\x08d\\q\x10(U\x11ZClasses.P ropertyq\x11U\x0eZInstanceSheetq\x12tq\x13tq\x14QU\x06_p_oidq\x15U\x08\x00\x00\x 00\x00\x00\x002nq\x16U\n__module__q\x17NU\t_p_serialq\x18U\x08\x038;\xa2\xb7n[\x b3q\x19utq\x1at.N.')) Could not load oid dF, pickled data in traceback info may contain clues I've never seen anything like this, and I'm certainly not using ZClasses. Anyone got a clue what's going on? cheers, Chris -- Simplistix - Content Management, Zope & Python Consulting - http://www.simplistix.co.uk

2 2

RE: [Zope-dev] How should an ideal Zope IDE look like?
by Jean-Francois.Doyon＠CCRS.NRCan.gc.ca 06 May '04

06 May '04

I agree with Andre. The feature list is ambitious, but complete. That's pretty much what I was about to write myself, but he beat me to it :) More important is the second point: Having such a tool would bring a HUGE amount of value added to Zope. Mega, super huge. In fact I was once presented with an OO CMS much like Zope, but commercial, where the IDE/Management interface was much like this ... That alone was worh the 50K price tag ... Want to load a document ? Click -> Drag -> Done. That simple. My main concern would be it's adaptibility to custom content types. If I have my own Geospatial-ish content type, how would the IDE handle it ? How would I go about making it handle it ? etc ... In some respects I thnk such a project would be best "hosted" with Zope itself, since to make it work really well you may need to do work real close to the core of Zope. Also, as mentionned given the immense value added to the product, I'm thinking ZC would benefit greatly from it and should maybe be involved ? Basically, yo me this should be a core feature of Zope, not an add-on. J.F. -----Original Message----- From: zope-dev-bounces(a)zope.org [mailto:zope-dev-bounces@zope.org]On Behalf Of Andre Meyer Sent: April 24, 2004 5:24 PM To: Aleks Totic Cc: Martin Kretschmar; zope-dev(a)zope.org Subject: Re: [Zope-dev] How should an ideal Zope IDE look like? It was not my expectation that you would go and implement all of this ;-) Of course, this is a lot of work, but much has been done by others, already. The wish list was intended as ideas for those capable and willing to contribute. The value of good tools for any technology cannot be underestimated. kind regards Andre Aleks Totic wrote: > Nice wishlist. About 3-4 man years worth of coding, 2 min is my guess. > > My goal is not quite so ambitious. I wanted to learn Eclipse well. I > was always jelaous of Emacs guys that could whip up a mode for their > favorite lanuguage. Implementing a Python IDE sounded like a good > starter project. By IDE, I mean something with a debugger. > > In the next release (by the end of next month) I'll have some > hyperlinking (function/classdefs withing the same file, and on > imports), maybe some code completion (that's up to Dana), and a decent > debugger (multithreaded). > > After that, I am not sure. My goal for pydev is for it to be good > enough for small-size projects, and we'll almost be there. The larger > projects requirements (unit tests/UML editor/module awareness) are not > that exciting as a hobby. > > Aleks > > Andre Meyer wrote: > >> So, I give it a try and submit a "wish list" for an ideal IDE for >> Python/Zope. >> >> Maybe some words about the IDEs I have been working with, so you can >> track where the features I wish to have come from: I used >> CodeWarrior, NetBeans, jEdit for both Java and Python/Zope, Boa >> Constructor and Eclipse with several plugins (like Omondo UML plugin, >> TruStudio and PyDev). >> >> And here comes the list of features: >> >> - Syntax coloring (standard everywhere) for python and >> zpt/xml/html/css code. >> >> - Commenting/uncommenting code (any hope Python will ever offer >> multi-line comments?). >> >> - Auto-completion for python and zpt/xml/html/css, incl. parameter >> editing. One should be able to specify the path to modules: for >> example I have a Python installation and a Zope installation with >> Python offering different modules. >> >> - Show declaration: jump to definition of classes/instances elsewhere >> in the code using a context menu. >> >> - Refactoring: actions, such as renaming a class, method or module >> and modify all references in the rest of the code; move classes and >> methods up or down in the class hierarchy. Eclipse supports this for >> Java and it saves a LOT of time, >> >> - Unit tests with reporting. >> >> - Folding: show/hide parts of the source code (like in jEdit). >> >> - Split windows. >> >> - Project management. >> >> - CVS/Subversion integration. >> >> - Search/replace, incl. regex in open files, project, >> >> - Compare and edit files/folders (diff, meld). >> >> - Drag&drop editing. >> >> - Multi-threaded debugging. >> >> - Outline: display classes, methods, attributes of a source file. >> >> - Class/method popup. >> >> - Bookmarks. >> >> - Class browser: multi-part window for browsing and editing classes >> and their methods and attributes. Similar to the NeXTstep file >> browser and the Java Browser perspective in Eclipse. >> >> - UML editor (incl. code generation and reverse engineering). Eclipse >> has several UML plugins and offers a language-independent modelling >> framework (EMF) that supports code generation. This could be adapted >> for Python. >> >> - Design patterns, templates: not found anywhere, yet, but might be >> an interesting feature, especially for Zope development, where we >> have a lot of recipes that need to be applied often. >> >> - Pydoc integration: show the docs simultaneously with the code. >> >> - ZPT debugging, sensible error messages. >> >> - ZODB inspection: give insight into what is actually stored in the >> ZODB. >> >> - Ftp, WebDav >> >> - Launching/restarting Zope locally and remotely. >> >> - Python and Jython support. >> >> - Live error tracking (while typing). >> >> - Task management. >> >> - Calling trees: who calls whom and who is called by whom? >> >> >> Well, there is certainly more, but this is a start... ;-) >> >> One could start from Eclipse/PyDev (http://pydev.sourceforge.net/) >> and add features. Does anybody (Martin) have concrete plans to do this? >> >> Also look at >> http://www.python.org/cgi-bin/moinmoin/EclipsePythonIntegration 5 for >> more ideas. >> >> kind regards and success >> Andre > > > > -- Dr. Andre P. Meyer http://home.hccnet.nl/a.meyer/ TNO FEL Command & Control and Simulation, http://www.fel.tno.nl/div2/ Delft Cooperation on Intelligent Systems, http://www.decis.nl/ _______________________________________________ Zope-Dev maillist - Zope-Dev(a)zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )

6 7

zLOG changes
by Andreas Jung 05 May '04

05 May '04

Hi Fred, there are currently two things confusing me: - the entries in the event.log are currently written without the log level. Is this dedicated behaviour? I think the log level should be part of the event.log - when adding LOG = getLogger(...) LOG.info(...) to some modules then the output is only written to the event.log but no longer to stdout (if running in debug mode). Is this change intentional? Andreas

5 13