- Zope-Dev - Zope lists

[Interested?] New use for Zope+CMF+Archetypes -- startup time improvements
by Dieter Maurer 27 May '05

27 May '05

Dear Zope developers, we have used Zope+CMF+Archetypes in a new way -- not as a Web Application framework but as a framework for desktop applications that share a large part of their functionality with online applications (implemented with Zope+CMF+Archetypes). A major stumbling block has been Zope's incredibly high startup time. We observerd times in the order of a minute on computers with either slow CPU or slow IO. This may be acceptable for a Web server but is prohibitive for a desktop application -- especially as the predecessor application started within a few seconds. To overcome this obstacle, we tweaked Zope and fixed Python's import mechanism such that Zope now starts either out of a ZIP archive or as a frozen application. These measures had the following results. Startup times on a mid range computer (AMD Athon 1.4 GHz; 512 MB memory) with a standard IDE disk. Cold start Warm start (after computer startup) (most files in OS cache) File system 13s 5s ZIP archive 8s 4s Frozen 5s 3s In more details, we did: * implement a package for a new kind of "url"s "pypackage:" for package relative access to resources. The package monkey patches Python's "open", "os.listdir", "os.stat" to provide transparent access to "pypackage:" identified resources. It currently support package relative access for packages loaded from the file system, from a ZIP archive and from the executable itself (i.e. frozen packages). In the last case, the resources are in a separate ZIP archive. This package might be interesting for Python as a whole as it is not Zope specific. * implement a shared object importer to be used as a Python "meta_path" hook. This importer allows to load shared objects into the context of a parent package (such as e.g. "ZODB.TimeStamp") although the shared object is not located inside the package's source (ZIP archive or executable). * fix about 70 occurrences in Zope code where package relative access was implemented by "dirname(__file__)" to consistenty use "package_home". * modify about a dozen places in Zope+CMF to use "pypackage:" and cope with "__path__" not being a list for frozen packages * fix a few products (Archetypes and friends, TextIndexNG2, PlacelessTranslationService, ...) to use "package_home" (rather than "dirname(__file__)") and not to change the current working directory (which obviously would fail for destinationsbe in a ZIP archive or the executable). * implement lazy loading of "ImageFile"s to reduce the risk of recursive imports (and reduce startup time). * support lazy product initialization * support configuration from a pickle file (to avoid expensive parsing of the schema and configuration files). The pickle is used as a configuration cache. * fixed Python's import mechanism not to treat ZIP archives as a directory when the archive could not find a module. If you were *really* interested in these startup time improvements, I could provide patches which might be integrated in the Zope core for e.g. Zope 2.9. -- Dieter

6 8

Zope 2.8.0b2: WinBuilder issue
by Christian Theune 26 May '05

26 May '05

Howdy, The InnoSetup complained about pythonservice.exe to be missing during packaging the installer. Any ideas? Cheers, Christian -- gocept gmbh & co. kg - schalaunische str. 6 - 06366 koethen - germany www.gocept.com - ct(a)gocept.com - phone +49 3496 30 99 112 - fax +49 3496 30 99 118 - zope and plone consulting and development

2 5

Re: [Zope-dev] Possible 2.8b2 bug part 3:
by Lennart Regebro 25 May '05

25 May '05

On 5/24/05, Andreas Jung <lists(a)andreas-jung.com> wrote: > + if isinstance(unicode, format): Well, this should be if isinstance(format, unicode): of course. But besides that, yes it works. -- Lennart Regebro, Nuxeo http://www.nuxeo.com/ CPS Content Management http://www.cps-project.org/

1 0

Re: [Zope-dev] Possible 2.8b2 bug part 3:
by Lennart Regebro 24 May '05

24 May '05

On 5/23/05, Andreas Jung <lists(a)andreas-jung.com> wrote: > A deprecation warning could do the job. To be honest I would have never > thought about > such a usecase :-) However we could convert unicode to utf8 and use this as > argument > for strftime() and converting the result back to unicode. Yeah, that works. Is there cases when this would not work? -- Lennart Regebro, Nuxeo http://www.nuxeo.com/ CPS Content Management http://www.cps-project.org/

2 2

Re: [Zope-dev] Possible 2.8b2 bug part 3:
by Lennart Regebro 23 May '05

23 May '05

On 5/23/05, Andreas Jung <lists(a)andreas-jung.com> wrote: > I am pretty sure you can build a workaround easily. In my point of view > the reason for the change (support for dates outside the usual 1970..2038 > scope) is more important. Well, I don't think we personally use any non-ascii characters, so we can work around it, but it does break backwards compatibility. We get an error when we use localize time and date strings, something I expect is pretty common, i.e., you translate a string "medium_date_format" with whatever translation tool you have, and then pass that as a date format. The translation tools will typically return unicode, and bam! it stops working. So, if we can't properly support unicode, I'd actually prefer that we cast the format string to string, perhaps with a deprecated warning if we pass unicode? -- Lennart Regebro, Nuxeo http://www.nuxeo.com/ CPS Content Management http://www.cps-project.org/

2 1

Possible 2.8b2 bug part 3:
by Lennart Regebro 23 May '05

23 May '05

DateTime.DateTime.strftime(fmt) used to use strftime, which accepts a unicode string as fmt. In 2.8 it uses datetime.datetime.strftime which does not accept unicode. This both breaks backwards compatibility, and prevents you from using non-ascii characters in the format string. Thoughts, opinions? -- Lennart Regebro, Nuxeo http://www.nuxeo.com/ CPS Content Management http://www.cps-project.org/

2 1

Zope 2.8b2 problems part 2: WingDBG and subtransactions.
by Lennart Regebro 23 May '05

23 May '05

WingDBG does this: tx = get_transaction().sub() That fails because 'Transaction' object has not attribute 'sub'. This is obviously an effect of the moving from subtransactions to checkpoints. Question: Is it Zope2.8 taht is wrong or WingDBG? -- Lennart Regebro, Nuxeo http://www.nuxeo.com/ CPS Content Management http://www.cps-project.org/

1 0

BastionLinux
by Alan Milligan 19 May '05

19 May '05

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, We're finally almost ready to release BastionLinux, https://linux.last-bastion.net, our exact functional equivalent of RHEL for commercial Zope and Plone customers. We have packaged quite a number of Python/Zope/Plone products on the Plope channel, https://linux.last-bastion.net/RPC2/up2date/plope. If we haven't talked to you already and you are the author of any of these, then we'd like to hear from you. We will soon be releasing our extra's RPM package workflow, so we'd also like to hear from you if you've any commercially orientated products you'd like to earn revenue for as well. If you support commercial customers, then we're also very interested in getting feedback from you about our reselling model. Alan -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.6 (GNU/Linux) Comment: Using GnuPG with Fedora - http://enigmail.mozdev.org iD8DBQFCjMk5CfroLk4EZpkRAopfAKDMpW7nD4Zhi+4gEC+MCTFPtjV0XgCfVbNn pFt7m9gSPJUZXYlklBoKgv8= =E4f5 -----END PGP SIGNATURE-----

1 0

[Zope3 / ECM] : Project launched !
by Julien Anguenot 17 May '05

17 May '05

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Paris, 16 May 2005 Dear Zope community, On behalf of Nuxeo, I'm pleased to announce that the Zope3 / ECM project is launched ! The main goal of this project is to build the next-generation Open Source ECM Platform on top of Zope3 able to compete with the major ECM solutions on the market such as Documentum, OpenText, etc... It's been discussed seriously since last year's Castle sprint, and some events occurred such as the Zope3 / ECM sprint [1]_ in March in Paris this year where people from the major Zope2 CMS projects were represented. (Plone, Silva, CPS and Zope Corporation people were there) showing everybody's interests in working together on a common project as a first commitment in this effort. .. [1]_ http://blogs.nuxeo.com/sections/blogs/fermigier/2005_03_18_paris_zope3_ecm_… We believe the first iteration for such a project is to : - discuss together and share our respective experiences - come up with an architecture that everybody feels good with - write specifications - validate the specifications. For now we set up : 1. a mailing list [2]_ 2. the project's resources repository. All interested parties are welcome / expected to subscribe to the mailing-list and join the portal. The website will soon (in next 2 days) contains documentation about some collaboration rules (that will be discussed on the mailing- list). For now, it contains a few document like some braindumps about the global infrastructure and some arcticles. [3]_ 3. Repository with the existing component started during last sprint plus some new ones [4]_ .. _[2] http://lists.nuxeo.com/mailman/listinfo/z3lab .. _[3] http://www.z3lab.org .. _[4] http://svn.nuxeo.org/trac/pub/browser/z3lab/ The project started under the name of z3lab. What is z3lab ? =============== Z3Lab aims at building a strong community leveraging the experiences of both individuals and companies that are involved in the Zope ECM/ CMS market nowadays to create the best ECM platform on the market and offer high-value professional services to customers. ECM Platform ============== The project's main goals are : - to unify the whole Zope/CMS-involved community to drastically reduce waste of resources (doing twice or more equivalent components / features). - to spread Zope3 technology on the market by providing a world class ECM Platform with companies providing consulting worldwide and backing the project. Open issues : ============== They are still some open issues that needs to be discussed and fixed : - For the moment, Nuxeo is hosting alpha code in its repository but this is not intended to be definitive. We just need to agree on a place where to put the code. codespeak.net is an option that will be considered seriously. If you want to take part of the discussion you may join the z3lab mailing list. But please, do not make it the main point of the discussion. There is a lot of work to do even before writing a useful single line of code (design / architecture specs for example). - Licensing : we consider using the ZPL. Same as above. We would really like to avoid all sterile flamewars :-) We have time to discuss these point *zenly* - Copyright Assignment. Until now the copyright assignment is on the contributor. Though, all the tools we need to start working are in place now and available on _[3]. To help the project bootstrap, 2 core developers of Nuxeo (Florent and Me) are staffed full-time on this project. On of the short term goal is to present some of the components to our community at EP this year. All the community has been waiting for a Zope3 based ECM far too long. It's the right time to move on *together*. Get involved now ! :) Best regards, J. - -- Julien Anguenot | Nuxeo R&D (Paris, France) CPS Plateform : http://www.cps-project.org mail: anguenot at nuxeo.com; tel: +33 (0) 6 72 57 57 66 -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.6 (GNU/Linux) Comment: Using GnuPG with Fedora - http://enigmail.mozdev.org iD8DBQFCiT5LGhoG8MxZ/pIRAg5VAJ48oT5ikeMJYLniT+ogTfn2KYcyfwCgih+2 FW9LgXjRH3T/BZyayyfSSj8= =pnJS -----END PGP SIGNATURE-----

1 0

inituser problem
by Chris Withers 14 May '05

14 May '05

Hi, I have a problem with the code in AccessControl.User.UserFolder._createInitialUser. It creates a user under what I feel are fairly bizarre circumstances. I feel it should simply use inituser if it's there and the user in it doesn't already exist in the root acl_users. Either that, or it should overwrite any user if the inituser file exists. The weird special case of one user being in the root acl_users seems extremely counterintuitive. What do other people feel? cheers, Chris -- Simplistix - Content Management, Zope & Python Consulting - http://www.simplistix.co.uk

2 1