May 2005 - Zope-Dev - Zope lists

RAMcache and container vs. context
by Paul Winkler 28 May '05

28 May '05

I never noticed this before today, but apparently RAMCacheManager is sensitive to whether cached items are acquired from the context or from the container. (Zope 2.7.3 but afaict it should behave the same in any recent version). Is that intended behavior or is this a bug? Let's say I have a CMF site at http://foo:8080/TheSite. And a template at /TheSite/portal_skins/custom/template1 which looks in part like like: ... Let's say that expensive_script is also in portal_skins/custom and is associated with a RAMCacheManager. Let's say that there are *no* request variables configured for this RAMCacheManager, which would seem to indicate that we consider all calls to expensive_script equivalent regardless of the request. If I visit http://foo:8080/TheSite/page1, which page makes use of this template, and I reload several times, and look at the RAMCacheManager statistics view, I see several hits for /TheSite/expensive_script. Every time I reload, the hit count goes up by one. So far so good. But if I then visit another page, http://foo:8080/TheSite/page2, which uses the same template, I get a miss and the entry count goes up by one. Reloading then gives me a hit, presumably from the new entry. If I browse around the site, the entry count increments for every new page I hit. Remember that I have nothing configured in the "REQUEST Variables" field. So the script should be the same regardless of the request right? This was puzzling me until, on a hunch, I looked at the calling template and changed it from this: ... ...to this: ... And presto, I now get only one entry, and every page on the site gives me a hit from that one entry. Is this really intended behavior? It's not obvious to me from the code why this is happening (or why it might be desirable). The cache manager stores and looks up items by their getPhysicalPath(), so I don't see why context vs. container is relevant. If I'd wanted the URL to be relevant, I would have put that in the REQUEST Variables configuration. This could be a performance hit for the unwary ... aside from all the unnecessary misses, we'd be using RAM on the order of N * M * S where N is number of cached items and M is number of pages in the site, and S is average size of return value. We only should be using N * S. -- Paul Winkler http://www.slinkp.com

5 8

[Interested?] New use for Zope+CMF+Archetypes -- startup time improvements
by Dieter Maurer 27 May '05

27 May '05

Dear Zope developers, we have used Zope+CMF+Archetypes in a new way -- not as a Web Application framework but as a framework for desktop applications that share a large part of their functionality with online applications (implemented with Zope+CMF+Archetypes). A major stumbling block has been Zope's incredibly high startup time. We observerd times in the order of a minute on computers with either slow CPU or slow IO. This may be acceptable for a Web server but is prohibitive for a desktop application -- especially as the predecessor application started within a few seconds. To overcome this obstacle, we tweaked Zope and fixed Python's import mechanism such that Zope now starts either out of a ZIP archive or as a frozen application. These measures had the following results. Startup times on a mid range computer (AMD Athon 1.4 GHz; 512 MB memory) with a standard IDE disk. Cold start Warm start (after computer startup) (most files in OS cache) File system 13s 5s ZIP archive 8s 4s Frozen 5s 3s In more details, we did: * implement a package for a new kind of "url"s "pypackage:" for package relative access to resources. The package monkey patches Python's "open", "os.listdir", "os.stat" to provide transparent access to "pypackage:" identified resources. It currently support package relative access for packages loaded from the file system, from a ZIP archive and from the executable itself (i.e. frozen packages). In the last case, the resources are in a separate ZIP archive. This package might be interesting for Python as a whole as it is not Zope specific. * implement a shared object importer to be used as a Python "meta_path" hook. This importer allows to load shared objects into the context of a parent package (such as e.g. "ZODB.TimeStamp") although the shared object is not located inside the package's source (ZIP archive or executable). * fix about 70 occurrences in Zope code where package relative access was implemented by "dirname(__file__)" to consistenty use "package_home". * modify about a dozen places in Zope+CMF to use "pypackage:" and cope with "__path__" not being a list for frozen packages * fix a few products (Archetypes and friends, TextIndexNG2, PlacelessTranslationService, ...) to use "package_home" (rather than "dirname(__file__)") and not to change the current working directory (which obviously would fail for destinationsbe in a ZIP archive or the executable). * implement lazy loading of "ImageFile"s to reduce the risk of recursive imports (and reduce startup time). * support lazy product initialization * support configuration from a pickle file (to avoid expensive parsing of the schema and configuration files). The pickle is used as a configuration cache. * fixed Python's import mechanism not to treat ZIP archives as a directory when the archive could not find a module. If you were *really* interested in these startup time improvements, I could provide patches which might be integrated in the Zope core for e.g. Zope 2.9. -- Dieter

6 8

Zope 2.8.0b2: WinBuilder issue
by Christian Theune 26 May '05

26 May '05

Howdy, The InnoSetup complained about pythonservice.exe to be missing during packaging the installer. Any ideas? Cheers, Christian -- gocept gmbh & co. kg - schalaunische str. 6 - 06366 koethen - germany www.gocept.com - ct(a)gocept.com - phone +49 3496 30 99 112 - fax +49 3496 30 99 118 - zope and plone consulting and development

2 5

Re: [Zope-dev] Possible 2.8b2 bug part 3:
by Lennart Regebro 25 May '05

25 May '05

On 5/24/05, Andreas Jung <lists(a)andreas-jung.com> wrote: > + if isinstance(unicode, format): Well, this should be if isinstance(format, unicode): of course. But besides that, yes it works. -- Lennart Regebro, Nuxeo http://www.nuxeo.com/ CPS Content Management http://www.cps-project.org/

1 0

Re: [Zope-dev] Possible 2.8b2 bug part 3:
by Lennart Regebro 24 May '05

24 May '05

On 5/23/05, Andreas Jung <lists(a)andreas-jung.com> wrote: > A deprecation warning could do the job. To be honest I would have never > thought about > such a usecase :-) However we could convert unicode to utf8 and use this as > argument > for strftime() and converting the result back to unicode. Yeah, that works. Is there cases when this would not work? -- Lennart Regebro, Nuxeo http://www.nuxeo.com/ CPS Content Management http://www.cps-project.org/

2 2

Re: [Zope-dev] Possible 2.8b2 bug part 3:
by Lennart Regebro 23 May '05

23 May '05

On 5/23/05, Andreas Jung <lists(a)andreas-jung.com> wrote: > I am pretty sure you can build a workaround easily. In my point of view > the reason for the change (support for dates outside the usual 1970..2038 > scope) is more important. Well, I don't think we personally use any non-ascii characters, so we can work around it, but it does break backwards compatibility. We get an error when we use localize time and date strings, something I expect is pretty common, i.e., you translate a string "medium_date_format" with whatever translation tool you have, and then pass that as a date format. The translation tools will typically return unicode, and bam! it stops working. So, if we can't properly support unicode, I'd actually prefer that we cast the format string to string, perhaps with a deprecated warning if we pass unicode? -- Lennart Regebro, Nuxeo http://www.nuxeo.com/ CPS Content Management http://www.cps-project.org/

2 1

Possible 2.8b2 bug part 3:
by Lennart Regebro 23 May '05

23 May '05

DateTime.DateTime.strftime(fmt) used to use strftime, which accepts a unicode string as fmt. In 2.8 it uses datetime.datetime.strftime which does not accept unicode. This both breaks backwards compatibility, and prevents you from using non-ascii characters in the format string. Thoughts, opinions? -- Lennart Regebro, Nuxeo http://www.nuxeo.com/ CPS Content Management http://www.cps-project.org/

2 1

Zope 2.8b2 problems part 2: WingDBG and subtransactions.
by Lennart Regebro 23 May '05

23 May '05

WingDBG does this: tx = get_transaction().sub() That fails because 'Transaction' object has not attribute 'sub'. This is obviously an effect of the moving from subtransactions to checkpoints. Question: Is it Zope2.8 taht is wrong or WingDBG? -- Lennart Regebro, Nuxeo http://www.nuxeo.com/ CPS Content Management http://www.cps-project.org/

1 0

BastionLinux
by Alan Milligan 19 May '05

19 May '05

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, We're finally almost ready to release BastionLinux, https://linux.last-bastion.net, our exact functional equivalent of RHEL for commercial Zope and Plone customers. We have packaged quite a number of Python/Zope/Plone products on the Plope channel, https://linux.last-bastion.net/RPC2/up2date/plope. If we haven't talked to you already and you are the author of any of these, then we'd like to hear from you. We will soon be releasing our extra's RPM package workflow, so we'd also like to hear from you if you've any commercially orientated products you'd like to earn revenue for as well. If you support commercial customers, then we're also very interested in getting feedback from you about our reselling model. Alan -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.6 (GNU/Linux) Comment: Using GnuPG with Fedora - http://enigmail.mozdev.org iD8DBQFCjMk5CfroLk4EZpkRAopfAKDMpW7nD4Zhi+4gEC+MCTFPtjV0XgCfVbNn pFt7m9gSPJUZXYlklBoKgv8= =E4f5 -----END PGP SIGNATURE-----

1 0

[Zope3 / ECM] : Project launched !
by Julien Anguenot 17 May '05

17 May '05

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Paris, 16 May 2005 Dear Zope community, On behalf of Nuxeo, I'm pleased to announce that the Zope3 / ECM project is launched ! The main goal of this project is to build the next-generation Open Source ECM Platform on top of Zope3 able to compete with the major ECM solutions on the market such as Documentum, OpenText, etc... It's been discussed seriously since last year's Castle sprint, and some events occurred such as the Zope3 / ECM sprint [1]_ in March in Paris this year where people from the major Zope2 CMS projects were represented. (Plone, Silva, CPS and Zope Corporation people were there) showing everybody's interests in working together on a common project as a first commitment in this effort. .. [1]_ http://blogs.nuxeo.com/sections/blogs/fermigier/2005_03_18_paris_zope3_ecm_… We believe the first iteration for such a project is to : - discuss together and share our respective experiences - come up with an architecture that everybody feels good with - write specifications - validate the specifications. For now we set up : 1. a mailing list [2]_ 2. the project's resources repository. All interested parties are welcome / expected to subscribe to the mailing-list and join the portal. The website will soon (in next 2 days) contains documentation about some collaboration rules (that will be discussed on the mailing- list). For now, it contains a few document like some braindumps about the global infrastructure and some arcticles. [3]_ 3. Repository with the existing component started during last sprint plus some new ones [4]_ .. _[2] http://lists.nuxeo.com/mailman/listinfo/z3lab .. _[3] http://www.z3lab.org .. _[4] http://svn.nuxeo.org/trac/pub/browser/z3lab/ The project started under the name of z3lab. What is z3lab ? =============== Z3Lab aims at building a strong community leveraging the experiences of both individuals and companies that are involved in the Zope ECM/ CMS market nowadays to create the best ECM platform on the market and offer high-value professional services to customers. ECM Platform ============== The project's main goals are : - to unify the whole Zope/CMS-involved community to drastically reduce waste of resources (doing twice or more equivalent components / features). - to spread Zope3 technology on the market by providing a world class ECM Platform with companies providing consulting worldwide and backing the project. Open issues : ============== They are still some open issues that needs to be discussed and fixed : - For the moment, Nuxeo is hosting alpha code in its repository but this is not intended to be definitive. We just need to agree on a place where to put the code. codespeak.net is an option that will be considered seriously. If you want to take part of the discussion you may join the z3lab mailing list. But please, do not make it the main point of the discussion. There is a lot of work to do even before writing a useful single line of code (design / architecture specs for example). - Licensing : we consider using the ZPL. Same as above. We would really like to avoid all sterile flamewars :-) We have time to discuss these point *zenly* - Copyright Assignment. Until now the copyright assignment is on the contributor. Though, all the tools we need to start working are in place now and available on _[3]. To help the project bootstrap, 2 core developers of Nuxeo (Florent and Me) are staffed full-time on this project. On of the short term goal is to present some of the components to our community at EP this year. All the community has been waiting for a Zope3 based ECM far too long. It's the right time to move on *together*. Get involved now ! :) Best regards, J. - -- Julien Anguenot | Nuxeo R&D (Paris, France) CPS Plateform : http://www.cps-project.org mail: anguenot at nuxeo.com; tel: +33 (0) 6 72 57 57 66 -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.6 (GNU/Linux) Comment: Using GnuPG with Fedora - http://enigmail.mozdev.org iD8DBQFCiT5LGhoG8MxZ/pIRAg5VAJ48oT5ikeMJYLniT+ogTfn2KYcyfwCgih+2 FW9LgXjRH3T/BZyayyfSSj8= =pnJS -----END PGP SIGNATURE-----

1 0