October 2005 - Zope - Zope lists

external editor
by Garry Saddington 08 Oct '05

08 Oct '05

I do not seem to be able to edit more than one file at a time in an external editor. Is this normal behaviour or am I missing something? regards Garry

3 3

Re: Mysql 5? Just curious.
by Greg Fischer 07 Oct '05

07 Oct '05

Oh, just read a little better... wanted to clarify... """ It doesnt work with stored procedures though. I put a patch up on sourceforge in July, for the ZMySQLDA. """ Mysql-python works fine fine, as you said Andy, it's just the Zope DA. Greg (I hate it when reply-all doesnt send to zope list too) On 10/7/05, Greg Fischer <retheoff(a)gmail.com> wrote: > > It doesnt work with stored procedures though. I put a patch up on > sourceforge in July, for the ZMySQLDA. > > > http://sourceforge.net/tracker/index.php?func=detail&aid=1242842&group_id=2… > > I probably didnt do it right, but I at least wanted to get the info up > there. (maybe should have listed a bug?) MySQLdb works fine directly from > python, but the DA doesnt open a connection with the right client_flags. It > needs MULTI_STATEMENTS. > > I just added this to db.py in _parse_connection_string, right before it > parses the socket. (line 234, I think) > > if not items: return kwargs > kwargs['client_flag'], items = int(items[0]), items[1:] > > One caveat, you must use a dash to turn off transactions. I don't know why > that is, or how to get around it. But, with that patch, and a connection > string like the one below, it works great! > > -adatabase auser apassword 65536 /tmp/mysql.sock > > I just wanted to specify the client_flags before the socket. Before you > couldnt specify them at all. On Linux this was fine, but on Windows, if > memory serves, the mysql.c had some issues. Maybe needs compiled with new > libs? > > Anyway, like I said on that patch post, there is probably a better way to > tackle the issue. I just did it this way, and it works for me. Though, the > transaction thing needs attention. > > Greg > > > > On 10/7/05, Andy Dustman <farcepest(a)gmail.com> wrote: > > > > On 10/7/05, Tres Seaver <tseaver(a)palladion.com> wrote: > > > Greg Fischer wrote: > > > > > > > I guess it's not a matter of should, but rather a preference. I am > > running > > > > it just fine on Linux. Had to do some tweeks to the ZMySQLDA, but it > > works > > > > great. Stored Procedures and everything. I just havent seen hardly > > anyone > > > > testing it, so I thought I would ask around and see if others are > > running it > > > > too. > > > > > > Cool. Could you send the patches for your tweaks to the ZMySQLDA > > > maintainer (Andy Dustman, I believe)? Maybe it would be better to > > > upload them to the SourceForge patches page: > > > > I've done a small amount of testing with MySQLdb-1.2.0 and MySQL-5.0, > > and there don't seem to be any issues, so ZMySQLDA-2.0.9 (latest beta) > > ought to work as well. There is a bugfix that needs to be applied (for > > the "tried to unlock unlocked lock" issue), but this should already be > > in the bug tracker on sourceforge. > > > > -- > > Computer interfaces should never be made of meat. > > http://www.terrybisson.com/meat.html > > > > > > -- > Greg Fischer > 1st Byte Solutions > http://www.1stbyte.com > -- Greg Fischer 1st Byte Solutions http://www.1stbyte.com

1 0

No cache headers
by Peter Bengtsson 07 Oct '05

07 Oct '05

This might be a FAQ but I've searched and just found a bunch of different results. Some old and some even older. What do you use to stop caching? IE users of my current project have reported problems of pages on updating. I'm not setting any caching at all so that's what IE does out of the box. (Firefox is not having a problem). Currently I'm using this: now = DateTime().toZone('GMT').rfc822() response.setHeader('Expires', now) response.setHeader('Last-Modified', now) response.setHeader('Cache-Control','no-cache') By inspection with LiveHTTPHeaders in Firefox it sets them all but I'm not 100% certain they will work. There's also the concern that I think M$ IE might have a bug in relation to that 'Cache-Control' header. There's some strange and now I just can't remember it or find out about it on google. So, what do you people use? Willing to share some of that? -- Peter Bengtsson, work www.fry-it.com home www.peterbe.com hobby www.issuetrackerproduct.com

3 2

Mysql 5? Just curious.
by Greg Fischer 07 Oct '05

07 Oct '05

This is totally unimportant, but I was just curious to know if anyone is running Mysql 5 on Zope right now. -- Greg Fischer 1st Byte Solutions http://www.1stbyte.com

4 4

Re: [Zope] Re: INSTALLING gcc (and ZOPE) on DEBIAN
by benmania＠web.de 07 Oct '05

07 Oct '05

Hello, Ok, does this error message mean that it is "just" a swap problem so that I wont have to install gcc, Python anymore? Having run "top", I could dectect that there is 10,241,428k total Swap. About 3,856,000k of it is actually being used and approximately 6,384,000k is free and about 463,000k is cached. I expect the 6,384,000k free space not to be enough - right? But what processes am I allowed to kill? Are there any processes that are absolutely neccessary? Ben Nikko Wolf <nikko-wolf(a)earthlink.net> schrieb am 06.10.05 17:00:38: > > Jens Vagelpohl wrote: > > > > On 6 Oct 2005, at 11:39, benmania(a)web.de wrote: > >> > >> virtual memory exhausted: Nicht genügend Hauptspeicher verfügbar > >> error: command 'gcc' failed with exit status 1 > >> make *** [build] Fehler 1 > > > > > > Have you actually *read* the output? It tells you, quite clearly, even > > in German, that you don't have enough memory on that machine. > > > > Indeed, although it's virtual memory (a.k.a. "swap space" or "swap" -- > although more RAM might help) Not meaning to insult you, but see: > http://de.wikipedia.org/wiki/Virtuelle_Speicherverwaltung > > At the command prompt, run "top" and look at the "Swap:" line, which > should show large values for "total" and "free" such as: > Swap: 1959888k total, 356276k used, 1603612k free, 124196k cached > > If "total" is high, but "free" is not, you can have 'ps' list the > virtual memory used by each process and sort it in increasing usage with > something like: > ps -Ao pid,user,stime,vsize,args | sort +3n > > Cheers, > N > > > ______________________________________________________________ Verschicken Sie romantische, coole und witzige Bilder per SMS! Jetzt bei WEB.DE FreeMail: http://f.web.de/?mc=021193

2 1

RE: [Zope] Zope Scalability
by John Snowdon 07 Oct '05

07 Oct '05

>-----Original Message----- >From: zope-bounces(a)zope.org [mailto:zope-bounces@zope.org] On >Behalf Of Jens Vagelpohl >Sent: 07 October 2005 09:04 >To: Zope ML >Subject: Re: [Zope] Zope Scalability > > >> As an aside, we find management of ZEO clients much easier >if each ZEO >> client of a particular system shares the same products and external >> methods via an NFS share. That way we can untar one product and >> push it >> out to all of the clients simultaneously. > >I'd be a little afraid of creating a single point of failure with >NFS. I have used setups like that before, but personally prefer some >simple distribution mechanism instead. > >If you use CVS or SVN for your software you could write simple SSH >scripts to visit hosts and do a cvs/svn up in the right place and >then restart the clients. rsync is a good candidate as well. > >jens > We don't have anything that complex :-) Most sites that we host probably have less than 20 external python methods (a lot have none at all!), with common products shared by all the sites installed on each system in the master zope lib/python/products directory structure. The majority of complexity is in each systems ZODB. All of our boxes are on a private network, on the same gbit switch as the ZEO server, so performance/service interruption, network timeouts etc.. is never a factor. The NFS shares (products, extensions, file upload areas[uploads via zope, and these areas are then served back out via Apache] and user home directories[again, using our ldap systems for authentication]) are from the same ZEO server (primary storage is handled by a multi-terabyte SATA). We're running about ~50 individual Zope systems at the moment (all as ZEO clients, many have multiple ZEO clients across several nodes, with incoming requests load balanced via Pound).. and I must say, this setup is way better than our old Sun E3500 that used to (try) to handle all of this! ZEO is the way to go for sure.... though we are now hitting problems when trying to integrate the Internet2's Shibboleth single sign on authentication system into a load-balanced setup... but that's a story for another time :-)

1 0

RE: [Zope] Zope Scalability
by John Snowdon 07 Oct '05

07 Oct '05

>--On 5. Oktober 2005 17:37:08 +0100 Tom Wilde ><tom.wilde(a)odconsultancy.com> >wrote: > >> Hi folks, >> >> I've been using Zope for a while now and found it to be an excellent >> solution however I've got a few enterprise questions about the >> scalability of Zope that just need to be answered. >> >> [ nb: I'm using V2.72 at the moment, not having moved over to V3 ] >> >> ExtFile >> Managed to serve 500,000 files through extfile - anybody >come across an >> upper limit here? Planning to serve larger sites off a SAN >hopefully - >> has anyone tried this? > >no idea For static content we still use Apache. >> >> Zeo and Cataloging >> If I have my site on one server and ZCatalog (using TextIndexNG) on >> another server (connected by ZEO) where does the actual >index operation >> occur? Do just the results get propogated to the catalog? > >The indexing work is always happens on the ZEO clients, not on >the server. >Just the results are transferred to the ZEO Server. > >> >> LDAP Authentication >> I understand that can use the LDAPUserFolder Product to provide >> authentication against an ldap server. Could I throw,say, >50000+ users >> at zope using this system? > >This should work in general. Possibly it requires some >tweaking here and >there depending on your usecases. We use LDAPUserFolder as the backend authentication store for our online learning environment here at newcastle. It copes rather well with several thousand students and many groups - I'd imagine it will scale as well as your LDAP setup can. (Our LDAP server is a pretty low-end Sun V60 - single Xeon 2.8GHz with 2Gb of ram and is very rarely under any significant load). >> >> Load Balancing and Cookie Based Sessions >> Currently we use cookie based sessions via cookie crumbler >presumably in >> a load balanced server setup we'd have to host acl_users ona ZEO'd >> izope instance somewhere on the backend? > > >I don't see what sessions have to do with acl_users. In your >ZEO setup you >have identical data except sessions on every ZEO client. You >just have to >ensure somehow that users get to the same ZEO client for the >lifetime of >the session. How this is done depends basically on the load balancer. We initially tied users sessions to individual ZEO clients (6 x dual Opteron nodes) and it worked well. However we have since migrated the session information to be served via the ZEO server in the same manner as the data.fs; we now get the benefit of much finer grained load balancing and are very pleased with the performance we get. As a side effect, it means we can host multiple ZEO clients from different systems on one box without fear of a particular ZEO client bringing the box to it's knees. As an aside, we find management of ZEO clients much easier if each ZEO client of a particular system shares the same products and external methods via an NFS share. That way we can untar one product and push it out to all of the clients simultaneously. -John -------------- Faculty of Medical Sciences Computing University of Newcastle upon Tyne

2 1

Re: Zope Digest, Vol 17, Issue 5
by Diana Maria Mieres Miranda 07 Oct '05

07 Oct '05

Hi, I´m new about Zope, I would like to know if does anybody can help me in develop a product zope, my idea are: make an engine search (like google), or make a translator for example translate a word to english-spanish or spanish-english, or make a personal agenda in zope, all should be products, so I would like to know if this is possible to develop in Zope this kind of ideas? or Can somebody help me in develop x product. Thanks. Regards. Diana Quoting zope-request(a)zope.org: > Send Zope mailing list submissions to > zope(a)zope.org > > To subscribe or unsubscribe via the World Wide Web, visit > http://mail.zope.org/mailman/listinfo/zope > or, via email, send a message with subject or body 'help' to > zope-request(a)zope.org > > You can reach the person managing the list at > zope-owner(a)zope.org > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of Zope digest..." > > > Today's Topics: > > 1. Re: Testing products: Testing all in one batch (Lennart Regebro) > 2. Re: ZOPE and DEBIAN INSTALLTION (Andreas Pakulat) > 3. Zope Scalability (Tom Wilde) > 4. Re: Zope Scalability (Andreas Jung) > 5. Re: Re: ZWiki RecentChanges as RSS feed (Peter Bengtsson) > 6. MailingLogger 2.4.1 and 2.5.0 Released! (Chris Withers) > 7. Re: Re: ZWiki RecentChanges as RSS feed (Simon Michael) > 8. Re: Problem with hasattr() and Zope 2.8.1 (Doyon, Jean-Francois) > 9. Re: Zope Scalability (Jens Vagelpohl) > 10. Re: Re: Problem with hasattr() and Zope 2.8.1 (Paul Winkler) > 11. Re: Re: Problem with hasattr() and Zope 2.8.1 (Paul Winkler) > 12. RE: Zope Scalability (Matthew X. Economou) > 13. Re: Zope Scalability (Jens Vagelpohl) > 14. Re: Zope Scalability (Tim Peters) > 15. Re: Zope Scalability (Andreas Jung) > 16. Re: Zope Scalability (Jens Vagelpohl) > 17. RE: Re: Problem with hasattr() and Zope 2.8.1 > (Doyon, Jean-Francois) > 18. Re: Zope Scalability (Tim Peters) > 19. Re: need help python-zope (Jonathan Cyr) > 20. Re: Re: DTML-tree Custom sort (J Cameron Cooper) > 21. New mailinglist for Zope 3 translators (Philipp von Weitershausen) > 22. Re: Mysql 5? Just curious. (Chris Withers) > 23. Re: INSTALLING gcc (and ZOPE) on DEBIAN (benmania(a)web.de) > 24. Re: Re: INSTALLING gcc (and ZOPE) on DEBIAN (Jens Vagelpohl) > 25. Re: ZOPE and DEBIAN INSTALLTION (Jonathan) > 26. Re: Zope Scalability (Lennart Regebro) > 27. Re: Mysql 5? Just curious. (Tino Wildenhain) > 28. Re: Testing products: Testing all in one batch (Chris Withers) > 29. Re: Re: Presentations Available (Chris Withers) > 30. How to prevent web access to specific folder ? (Vladimir Petrovic) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Wed, 5 Oct 2005 17:56:28 +0200 > From: Lennart Regebro <regebro(a)gmail.com> > Subject: Re: [Zope] Testing products: Testing all in one batch > To: Jens Vagelpohl <jens(a)dataflake.org> > Cc: Zope ML <zope(a)zope.org> > Message-ID: > <319e029f0510050856l762dc6em1984c5f79c862f0a(a)mail.gmail.com> > Content-Type: text/plain; charset=ISO-8859-1 > > On 10/5/05, Jens Vagelpohl <jens(a)dataflake.org> wrote: >> This is correct, but you're just papering over a deeper problem, >> namely bad cleanup in some unit tests. > > Sure, but that's how reality looks. It's unfortunate, but there ya go. > -- > Lennart Regebro, Nuxeo http://www.nuxeo.com/ > CPS Content Management http://www.cps-project.org/ > > > ------------------------------ > > Message: 2 > Date: Wed, 5 Oct 2005 18:04:43 +0200 > From: Andreas Pakulat <apaku(a)gmx.de> > Subject: Re: [Zope] ZOPE and DEBIAN INSTALLTION > To: zope(a)zope.org > Message-ID: <20051005160443.GA28254(a)morpheus.apaku.dnsalias.org> > Content-Type: text/plain; charset=us-ascii > > On 05.10.05 17:09:45, benmania(a)web.de wrote: >> Hello, >> >> I tried to install ZOPE from sources via "configure - make - make >> instance" but unfortunately I always get the following error message >> when typing in the "make" command. >> >> > > command 'gcc' failed with exit status 1 >> > > -basherror:: command not found > > Could you please post the whole output that "make" produces? I just > tested this on my box with zope-2.7.7 and it works. Do you have > python-dev installed? > > Andreas > > -- > So you're back... about time... > > > ------------------------------ > > Message: 3 > Date: Wed, 05 Oct 2005 17:37:08 +0100 > From: Tom Wilde <tom.wilde(a)odconsultancy.com> > Subject: [Zope] Zope Scalability > To: zope(a)zope.org > Cc: support(a)odconsultancy.com > Message-ID: <1128530228.4932.59.camel(a)odmulti.odconsultancy.com> > Content-Type: text/plain; charset="us-ascii" > > Hi folks, > > I've been using Zope for a while now and found it to be an excellent > solution however I've got a few enterprise questions about the > scalability of Zope that just need to be answered. > > [ nb: I'm using V2.72 at the moment, not having moved over to V3 ] > > ZODB size > What is the maximum size of this file and/or maximum object ID? > => just how many objects can the zodb hold? millions? tens of > millions..?? billions...??? I have a feeling we'll run out of ram long > before actually hitting the limit but it'd be nice to know the > theoretical top limit. > > ExtFile > Managed to serve 500,000 files through extfile - anybody come across an > upper limit here? Planning to serve larger sites off a SAN hopefully - > has anyone tried this? > > Zeo and Cataloging > If I have my site on one server and ZCatalog (using TextIndexNG) on > another server (connected by ZEO) where does the actual index operation > occur? Do just the results get propogated to the catalog? > > LDAP Authentication > I understand that can use the LDAPUserFolder Product to provide > authentication against an ldap server. Could I throw,say, 50000+ users > at zope using this system? > > Load Balancing and Cookie Based Sessions > Currently we use cookie based sessions via cookie crumbler presumably in > a load balanced server setup we'd have to host acl_users ona ZEO'd > izope instance somewhere on the backend? > > thanks in advance, any advice welcome - in a brave new world here. > > Tom > > > > > >

1 0

Re: INSTALLING gcc (and ZOPE) on DEBIAN
by benmania＠web.de 06 Oct '05

06 Oct '05

> $ which gcc > /usr/bin/gcc After entering which gcc, I always get the following output: /usr/bin/gcc The whole error message is (after entering the "make" - command) : ------------------------------------------- "/usr/bin/python" "/Zope-2.7.5-final/setup.py"\ build --build-base="/Zope-2.7.5-final/build-base/python-2.3" --build-lib="/Zope-2.7.5-finale/build-base/python-2.3/build-lib" --build-scripts="/Zope-2.7.5-finale/build-base/python-2.3/build-scripts" --build-temp="/Zope-2.7.5-final/build-base/python-2.3/build-temp" running build running build_py running build_ext building 'ExtensionClass' extensions gcc -pthread -fno-strict-aliasing -DNDEBUG -g -O3 -Wall -Wstrict-prototypes -fPIC -I/Zope-2.7.5-final/lib/Components/ExtensionClass/src -I/usr/include/python2.3 -c ../Components/ExtensionClass/src/ExtensionClass.c -o /Zope-2.7.5-final/build-base/python-2.3/build-temp/../Components/ExtensionClass/src/ExtensionClass.o virtual memory exhausted: Nicht genügend Hauptspeicher verfügbar error: command 'gcc' failed with exit status 1 make *** [build] Fehler 1 ------------------------------------------- __________________________________________________________________________ Erweitern Sie FreeMail zu einem noch leistungsstarkeren E-Mail-Postfach! Mehr Infos unter http://freemail.web.de/home/landingpad/?mc=021131

3 2

Testing products: Testing all in one batch
by Paul Winkler 06 Oct '05

06 Oct '05

Has anybody set up a batch job to test all installed Products in a zope instance? Seems like the only *useful* way I can get it to run is with a loop that does "bin/zopectl test" once for each subdirectory of Products that I actually care about, taking care to ignore problematic third-party products. Which is OK I guess, but I'd prefer not to have to skip anything. I think you *should* be able to simply do "./bin/zopectl test" and that will run everything, but with real-world products this seems to be a huge mess that spews a lot of red herring errors: - Some otherwise excellent third-party products have tests with dependencies that the product itself does not have, and which I do not want to install. (I will contact the author(s) privately.) - Some third-party products (e.g. CMF) ship with tests that just plain fail. If I install CMF 1.4.8 and nothing else, and run ./bin/zopectl test, I get 1 error and 1 failure. This is a bit surprising from a stable release, I'd expect not to get any... will forward those to the CMF list and follow up there, if there are not already issues filed for these. - Some of my own Product tests run fine in isolation but break when run alongside other installed product tests. That's its own issue which I will take up in a separate thread. I guess my overall questions are.... - Does this jibe with others' experience? - Is there a better (or best) way to run all my Product tests? - *Should* we expect that ./bin/zopectl test will run all installed Products tests, and if so, what can we do as a community to get authors to fix their products? p.s. you may notice a series of messages from me re. testing... i'm trying to sort out a bunch of issues at once, and want to try to keep the issues separate. -- Paul Winkler http://www.slinkp.com

4 7