- Zope - Zope lists

RE: [Zope] Data Insert Problems
by Jay Zeemer 24 Mar '05

24 Mar '05

Chris, I will look into using the SimpleUserFolder you spoke of thank you for the recommendation. We are currently writing to a MS SQL database. The form we are using contains 5 fields, and each insert causes the Data.fs to grow by approx 27K, the final form will be 10 times this size. If we grep the Data.fs for data we inserted we can find lines in the file containing this information. Do you believe this could be a problem with the database driver we are currently using?? We are currently running ZEO, and manually pack it during testing at about 1 to 1.5 gigs. This usually drops it down to the 200 meg range. We are seeing approximately 60% of the data we inserted on the front-end make it to the SQL database. We believe this is because of the conflict errors we are logging at 20 concurrent users. We need the system to support at a minimum 34 concurrent users on this form, more would be better. We have also tested this on a single box with a local Data.fs and have had similar results when testing through put on the form. We are re-running this test to check some other things I will let you know if the results change. It would appear our largest problem is with getting information moved through the Data.fs file. Is there any way to either work around the Data.fs or a way to increase its ability to handle multiple writes?? Thanks for the help in this problem!! Jay -----Original Message----- From: Chris Withers [mailto:chris@simplistix.co.uk] Sent: Wednesday, March 23, 2005 9:08 AM To: Jay Zeemer; zope(a)zope.org Subject: Re: [Zope] Data Insert Problems Hi Jay, Jay Zeemer wrote: > Our primary requirements for useing XUF is to allow external > authentication of users from a database?? Is there a better solution then > this?? If users from a relational database is all you want, then use SimpleUserFolder and follow the included docs ;-) (I have a newer unreleased version if you run into any problems, but you shouldn't) > Also, the app we would like to use Zope for is a very write itensive > application, Yes, but writing to what? What RDB are you using? > the problems we are seeing with Zope currently are that the > Data.fs is growing at a pretty decent size because the form appears to be > writting to the Data.fs first What evidence do you have to support this hypothesis? > being stored. Our estimates have us causing the Data.fs to grow by more > then 2 gigs per day. How often are you packing? Are you running ZEO? > Is there any possible way to increase the load that > Zope's Data.fs can handle, currently we are seeing about a 40% drop at 20 > concurrent users, over a few hours. 40% of what? relative to what? > Do you know of any way to ramp up the > number of connections that Data.fs can handle?? Why do you think you need to? ;-) cheers, Chris -- Simplistix - Content Management, Zope & Python Consulting - http://www.simplistix.co.uk

2 1

IE7 for Zope
by Greg Steffensen 24 Mar '05

24 Mar '05

Hey, its pretty trivial, but I've created a Zope wrapper for Dean Edward's fantastic IE7 tool ( http://dean.edwards.name/IE7 ). I've uploaded it as a Zope XML export file, and it can be used by simply importing then including <dtml-var "ie7.tag()"> (or something analagous) somewhere in the head section of your pages. Any feedback, on my packaging or installation procedure, would be very welcome. You can check out my release here: http://www.zope.org/Members/gsteff Greg Steffensen

1 0

RE: [Zope] Data Insert Problems
by Jay Zeemer 23 Mar '05

23 Mar '05

Chris We have done a bunch of work here, and it seems that what is happening is that the form is posting data into Data.fs then out to the SQL database?? Is this normal?? Is there any way to bypass the this process of data going into the Data.fs file?? If we can not bypass the Data.fs is there any way around the 2 gig ceiling it seems to have?? Thanks for all the help!! Jay -----Original Message----- From: Jay Zeemer Sent: Tuesday, March 22, 2005 8:24 AM To: 'Chris Withers' Cc: zope(a)zope.org Subject: RE: [Zope] Data Insert Problems Chris We are using the xuser folder... Jay -----Original Message----- From: Chris Withers [mailto:chris@simplistix.co.uk] Sent: Tuesday, March 22, 2005 8:22 AM To: Jay Zeemer Cc: zope(a)zope.org Subject: Re: [Zope] Data Insert Problems Jay Zeemer wrote: > It is coming from the acl_users object.. We have it setup to authenticate > against an external database, and to use cookies.. Do you believe this maybe > our problem?? Almost certainly. What userfolder implementation are you using? cheers, Chris -- Simplistix - Content Management, Zope & Python Consulting - http://www.simplistix.co.uk _______________________________________________ Zope maillist - Zope(a)zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )

3 2

Re: [Zope] zForum problem
by Cliff Ford 23 Mar '05

23 Mar '05

OK - I am stumped! I have just created a zForum in my root folder without a hitch. The problem is nothing to do with the root folder acl_users folder or the database connection. It has to be something to do with CookieCrumbler. Check you only have one installed (I assume you are not using Plone). Check the version - mine is CookieCrumbler-1.2. Have a look in __init__.py and CookieCrumbler.py to check they both have manage_addCC references (i.e. have not been corrupted). Check that files in the CookieCrumbler folder have read permission for the zope user. You say the error keeps popping up again and again. Do you mean it pops up many times during one installation attempt, or just once for each of many attempts? I this doesn't help you will need help from zForum or CookieCrumbler experts. Did you try not checking the Create user folder checkbox? That leaves out creation of acl_users so may not bother with the addCC call. Cliff H Jansen wrote: > I've gone through your details, yet I'm still stuck ;-( : > > Cookie Crumbler is in the 'Add dropdown' list. Further, I try to keep > things simple as possible: zForum creation in root folder ("/"), single > acl_user ('zope', who is the Manager and by default has all permissions > including read/write permissions.); these all are aquired by > CookieCrumbler, zForum folders however do not exist at this stage since > zForum doesn't get past its instantiation. The error message: > > >>>>""" >>>>Site ErrorAn error was encountered while publishing this resource. >>>> >>>>Error Type: AttributeError >>>>Error Value: manage_addCC >>>>""" > > > keeps popping up again and again. The zope manager's password in acl_users is > different from that used in the database connection string; that can't be the > problem can it...? > > > On Wed, 2005-03-23 at 15:05, Cliff Ford wrote: > >>Forgot to cc the list in the last reply. Line 142 of zForum.py says: >> >>CookieCrumbler.manage_addCC('cookie_authentication') >> >>and the error message is saying that it can't find manage_addCC in >>CookieCrumbler (I have taken out the rest of the Error log from this >>reply because it contained a plain text database connection string). >> >>Check that your Add dropdown list has Cookie Crumbler (Standalone) in >>its list and that the Zope user has read/write access to the >>CookieCrumbler and zForum folders. >> >>I have a test zForum installed and it just worked! If I create another >>with a dud database connection string I get a database error when trying >>to View (the installation appeared to work OK). >> >>Cliff >> >>H Jansen wrote: >> >>>Yep, that works. Here we go: >>> >>>Exception traceback >>> >>>Time >>>2005/03/23 14:08:12.432 GMT+1 >>>User Name (User Id) >>>zope (zope) >>>Request URL >>>http://localhost:8080/mfts.nl/manage_addProduct/zForum/manage_addZForum >>>Exception Type >>>AttributeError >>>Exception Value >>>manage_addCC >>> >>>Traceback (innermost last): >>> >>> * Module ZPublisher.Publish, line 101, in publish >>> * Module ZPublisher.mapply, line 88, in mapply >>> * Module ZPublisher.Publish, line 39, in call_object >>> * Module Products.zForum.zForum, line 87, in manage_addZForum >>> * Module Products.zForum.zForum, line 116, in __init__ >>> * Module Products.zForum.zForum, line 142, in zfSetupSystem >>>AttributeError: manage_addCC >>> >>> >> >>... snip ... >> >> >>>On Wed, 2005-03-23 at 12:04, Cliff Ford wrote: >>> >>> >>>>Look at the Error Log for the Traceback, which tells you exactly where >>>>the error occurred. That can often help pinpoint the problem by module >>>>and line number - look at the Product code if necessary. Include the >>>>Traceback in any question to the mailing list. >>>> >>>>Cliff >>>> >>>>burley(a)zonnet.nl wrote: >>>> >>>> >>>>>I've problems getting the zForum product working. When I try to create azForum >>>>>instance somewhere in my Zope site, I invariably obtain the errormessage: >>>>> >>>>>""" >>>>>Site ErrorAn error was encountered while publishing this resource. >>>>> >>>>>Error Type: AttributeError >>>>>Error Value: manage_addCC >>>>>""" >>>>>Looking for a solution on the internet, the closest I could get was >>>>>asdescribed in http://www.pcfltd.co.uk/docs/zforum.html (which is >>>>>aboutinstallation on a Windows machine; I'm working on Linux box). >>>>> >>>>>In the directory where I want to create the zForum: >>>>>1) I do have a database connection which is open en tested (works). >>>>>2) I do have a CookieCrumbler instance (which I'm not sure of whetherit's >>>>>essential or not...); the CookieCrubler properties are unchanged... (i.e. >>>>>__ac, __ac_name, __ac_password, etc) >>>>>3) In the zForum instance form I use the same connection string asdefined in >>>>>the database connection. >>>>> >>>>>The Site Error message keeps popping up all the time (...sigh). >>>>>Anyone some idea what's wrong...? >>>>> >>>>> >> >>_______________________________________________ >>Zope maillist - Zope(a)zope.org >>http://mail.zope.org/mailman/listinfo/zope >>** No cross posts or HTML encoding! ** >>(Related lists - >> http://mail.zope.org/mailman/listinfo/zope-announce >> http://mail.zope.org/mailman/listinfo/zope-dev )

2 1

RE: [Zope] Re: DeadlockDebugger changes
by Matthew X. Economou 23 Mar '05

23 Mar '05

Florent, Thank you for the wonderful tool. It has been a tremendous help. I have a feature request. Instead of configuring DeadlockDebugger by editing "custom.py", can I configure it by adding appropriate entries to $INSTANCE/etc/zope.conf or some other per-instance configuration file? I ask because I would like to install DeadlockDebugger in a server-wide Zope Products directory (instead of installing it in the per-instance Products directory). Not all of the Zope instances are owned by the same people. Best wishes, Matthew -- "The challenge of a moral life is to do nothing that requires forgiveness." - Roger Ebert in his review of _The Woodsman_

2 1

Zope process dies in minutes
by Nicholas Shewmaker 23 Mar '05

23 Mar '05

I would really like to build a Zope+Plone intranet, but I'm having a great deal of difficulty getting Zope 2.7 to stay alive on Fedora Core 3. Most of my searching indicates that this is a memory issue, but I've seen it on two different boxes. The first has 768MB RAM and the second has 256MB, with an additional 4GB partition as swap space. I've seen a supposed fix for RH9 (http://mail.zope.org/pipermail/zope/2003-May/135544.html) but that involves a Zope start script, which I either don't have or can't find. Can anyone tell me how to keep Zope 2.7 running on FC3? Thanks in advance.

2 2

Re: [Zope] shared/virtual hosting recommendations
by Chris Withers 23 Mar '05

23 Mar '05

AM Thomas wrote: > Hi Chris, > > I've heard only positive things from other people about Zettai; could > you tell me a little more about your problems with them? I'd > appreciate it. They decided to dump TinyTablePlus from their product roster because it's "too old". It actually hasn't been updated in years because it's rock solid and hasn't needed even the tiniest of updates. This was pointed out to them by several people but they chose to dig their heels in and be totally inflexible, forcing at least one of their customers to seek hosting elsewhere. Thier attitude worries me, the come across as unprofessional and childish in some of their support dealings from what I've heard, but these could just as easily be isolated incidents from frustated customers. I'm jsut passing on info that I've received from 2 or 3 seperate people now. cheers, Chris -- Simplistix - Content Management, Zope & Python Consulting - http://www.simplistix.co.uk

2 3

Re: [Zope] Data Insert Problems
by Chris Withers 23 Mar '05

23 Mar '05

Hi Jay, Jay Zeemer wrote: > Our primary requirements for useing XUF is to allow external > authentication of users from a database?? Is there a better solution then > this?? If users from a relational database is all you want, then use SimpleUserFolder and follow the included docs ;-) (I have a newer unreleased version if you run into any problems, but you shouldn't) > Also, the app we would like to use Zope for is a very write itensive > application, Yes, but writing to what? What RDB are you using? > the problems we are seeing with Zope currently are that the > Data.fs is growing at a pretty decent size because the form appears to be > writting to the Data.fs first What evidence do you have to support this hypothesis? > being stored. Our estimates have us causing the Data.fs to grow by more > then 2 gigs per day. How often are you packing? Are you running ZEO? > Is there any possible way to increase the load that > Zope's Data.fs can handle, currently we are seeing about a 40% drop at 20 > concurrent users, over a few hours. 40% of what? relative to what? > Do you know of any way to ramp up the > number of connections that Data.fs can handle?? Why do you think you need to? ;-) cheers, Chris -- Simplistix - Content Management, Zope & Python Consulting - http://www.simplistix.co.uk

1 0

Re: [Zope] Query Keyword Index unexpected behavior
by Yuri 23 Mar '05

23 Mar '05

> > > Dieter Maurer wrote: > >>>>>should return objects that have both "foo" AND "bar". In my case, no objects >>>>>with "bar", but with "foo" a lot. The expr above returns ALL objects with >>>>>"foo". Is it expected behavior? >>> >>> >>> >>> A really long standing bug... >> >> > >Is there a collector entry for this? > >cheers, > >Chris > Dear Chris, this is an "already discussed issue" :) http://www.dzug.org/mailinglisten/zope-org-zope/archive/2003/2003-12/107070… > The ZCatalog treats an empty *string* in a special way to support[...] "AND"[...] I've solved it in /PluginIndexes/common/util.py. When the param is a record, around line 95, I've added: if keys == ['']: keys = None Is it correct? Seems to work with all indexes I've and KeywordIndexes, which works also with AND as operator. --- Note: you also have to use lines to use the KeywordIndex: <textarea name="COLL:lines"></textarea> That was my solution. I think the "ManagableIndex" with the KeywordIndex replacement should be added, maybe calling it KeywordIndexNG :)

2 1

Re: Re: [Zope] tal:atrributes problem
by Jürgen Herrmann 23 Mar '05

23 Mar '05

[ Lennart Regebro wrote:] > On Wed, 23 Mar 2005 13:17:07 +0100 (CET), Jürgen Herrmann >> as far as i remeber the selected attribute should only contain >> 'selected' if you'd like to be xhtml compliant. >> >> but hey, if your version works with the standard browsers, i'll also go for this version, cause it's much more readable... > > Well, this code: > <option tal:repeat="statusid statuslist" > tal:attributes="value statusid; > selected python:status==statusid" > tal:content="statusid" /> > > results in this html: > > <option selected="selected" value="ACCEPTED">ACCEPTED</option> > > <option value="DECLINED">DECLINED</option> > <option value="TENTATIVE">TENTATIVE</option> > <option value="DELEGATED">DELEGATED</option> > > So it seems to be fine (For Zope 2.7.4 at least). looks fine! i thought it would produce something like : <option selected="True" value="ACCEPTED">ACCEPTED</option> ^^^^ though i had never tried it before... as i looked at TALInterpreter.py, obviously 'selected' is one of a handful of html attributes that get special treatment... line 33: BOOLEAN_HTML_ATTRS = [ # List of Boolean attributes in HTML that should be rendered in # minimized form (e.g. <img ismap> rather than <img ismap="">) # From http://www.w3.org/TR/xhtml1/#guidelines (C.10) # XXX The problem with this is that this is not valid XML and # can't be parsed back! "compact", "nowrap", "ismap", "declare", "noshade", "checked", "disabled", "readonly", "multiple", "selected", "noresize", "defer" ] regards, juergen herrmann _______________________________________________________________________ >> XLhost.de - eXperts in Linux hosting << Juergen Herrmann Weiherweg 10, 93051 Regensburg, Germany Fon: +49 (0)700 XLHOSTDE [0700 95467833] Fax: +49 (0)721 151 463027 ICQ: 27139974 - IRC: #XLhost@quakenet WEB: http://www.XLhost.de

1 0