December 2000 - Zope-Dev

partial search performance problems...
by John Eikenberry 21 Dec '00

21 Dec '00

I just did some tests on the performance of the partial matching features of ZCatalog. They weren't as good as I hoped. A Catalog of 2000 objects, text index on a 10 char string (person's last name), with a partial search that will match only 200 items... it takes 10 seconds. At 1000 matches it takes over a minute. And Zope is inaccessible this entire time. This is after I upgraded to Python-2.0 for the new re module (which helped) and messing with interpreter check interval (which didn't really help). Are there any other tricks to get this to perform better? Aside from switching to a relational database. -- John Eikenberry [jae(a)zhar.net - http://zhar.net] ______________________________________________________________ "A society that will trade a little liberty for a little order will deserve neither and lose both." --B. Franklin

1 0

Loginmanager and local roles
by morten＠esol.no 21 Dec '00

21 Dec '00

Using LoginManager, I can't seem to map local roles to users that are stored in LoginManager instances. I.e.: if this acl_users is a LoginManager /a/b/c/acl_users then any object in /a/b/c/d will not show any of the users stored in the nearest acl_users object in the local roles management menu.. Any suggestions? -Morten

3 3

ZCatalog very unhappy
by Jason Spisak 21 Dec '00

21 Dec '00

Help! Using the Catalog in 2.2.4 2000-12-20T00:59:58 ERROR(200) UnIndex unindex_object tried to retrieve set None from index 51346800 but couldn't. This should not happen. ------ 2000-12-20T01:00:00 ERROR(200) UnIndex unindex_object tried to retrieve set None from index but couldn't. This should not happen. ------ 2000-12-20T01:00:10 ERROR(200) UnIndex unindex_object tried to retrieve set None from index 942134400 but couldn't. This should not happen. ------ 2000-12-20T01:01:48 ERROR(200) UnIndex unindex_object tried to retrieve set None from index 51346800 but couldn't. This should not happen. ------ 2000-12-20T01:01:50 ERROR(200) UnIndex unindex_object tried to retrieve set None from index but couldn't. This should not happen. ------ 2000-12-20T01:02:21 ERROR(200) UnIndex unindex_object tried to retrieve set None from index 938070000 but couldn't. This should not happen. ------ 2000-12-20T01:02:37 ERROR(200) UnIndex unindex_object tried to retrieve set None from index 938761200 but couldn't. This should not happen. ------ 2000-12-20T01:03:08 ERROR(200) UnIndex unindex_object tried to retrieve set None from index 938588400 but couldn't. This should not happen. ------ 2000-12-20T01:04:57 ERROR(200) UnIndex unindex_object tried to retrieve set None from index 937551600 but couldn't. This should not happen. ------ 2000-12-20T01:04:57 ERROR(200) UnIndex unindex_object tried to retrieve set None from index 937897200 but couldn't. This should not happen. ------ 2000-12-20T01:06:03 ERROR(200) UnIndex unindex_object tried to retrieve set None from index 938415600 but couldn't. This should not happen. ------ 2000-12-20T01:06:33 ERROR(200) UnIndex unindex_object tried to retrieve set None from index 938502000 but couldn't. This should not happen. ------ 2000-12-20T01:09:19 ERROR(200) UnIndex unindex_object tried to retrieve set None from index 933750000 but couldn't. This should not happen. ------ 2000-12-20T01:09:22 ERROR(200) UnIndex unindex_object tried to retrieve set None from index 938674800 but couldn't. This should not happen. ------ 2000-12-20T01:12:44 ERROR(200) UnIndex unindex_object tried to retrieve set None from index 937465200 but couldn't. This should not happen. Jason Spisak CIO __ ___ ______ __ / // (_)_____/_ __/__ ____/ / ___ _______ __ _ / _ / / __/ -_) / / -_) __/ _ \(_-<_/ __/ _ \/ ' \ /_//_/_/_/ \__/_/ \__/\__/_//_/___(_)__/\___/_/_/_/ 6151 West Century Boulevard Suite 900 Los Angeles, CA 90045 P. 310.665.3444 F. 310.665.3544 Under US Code Title 47, Sec.227(b)(1)(C), Sec.227(a)(2)(B) This email address may not be added to any commercial mail list with out my permission. Violation of my privacy with advertising or SPAM will result in a suit for a MINIMUM of $500 damages/incident, $1500 for repeats.

3 4

calling SQL from External Method and using acquisition
by Andy McKay 20 Dec '00

20 Dec '00

This is just an annoying namespace issue: - I'm calling SQL methods from External Methods by <dtml-var create_index_ext>. - I can then call a SQL method by calling self.sql_method() But (there is always a but): - I have to manually pass all the arguments, very annoying. Work arounds that seem to work - manually pass all the arugments, great except its my code rigid, Id like to use acquistion - call a "wrapper" DTML Method, which calls the ZSQL method, I still have to pass manually but then get to use acquistion to pick up other stuff. Very cool. But now I hace one wrapper class for every SQL method. Is there a simpler way I have missed? -- Andy McKay, Developer. ActiveState.

1 0

kill_zombies
by J�lio Dinis Silva 20 Dec '00

20 Dec '00

Hi, since I started to use zeo, my medusa debug, /status/close_zombies stop to work. Is there another way to call this method close_zombies or kill_zombies? thanx, Júlio Dinis Silva _________________________________________________________________________ Get Your Private, Free E-mail from MSN Hotmail at http://www.hotmail.com.

1 0

Performance enhancements, ZCatalog
by Jason Spisak 20 Dec '00

20 Dec '00

ZCatalog enthusiasts, I just upgraded our zope installation from 2.1.6 to 2.2.4, and the ZCatalog performance is aweful. Can someone remind me what the command for speeding up python on a dual processor machine is? python -T? I'm looking for any way to speed this up. I have a text index with 47,000 objects and a search takes about 15-18 seconds, hardly what we were used to. It used to be 2 second tops. My company is being shopped around and if we get bought I want to convince the new company that Zope and python and Linux are the way to go. I need all the help I can get. All my best, Jason Spisak CIO __ ___ ______ __ / // (_)_____/_ __/__ ____/ / ___ _______ __ _ / _ / / __/ -_) / / -_) __/ _ \(_-<_/ __/ _ \/ ' \ /_//_/_/_/ \__/_/ \__/\__/_//_/___(_)__/\___/_/_/_/ 6151 West Century Boulevard Suite 900 Los Angeles, CA 90045 P. 310.665.3444 F. 310.665.3544 Under US Code Title 47, Sec.227(b)(1)(C), Sec.227(a)(2)(B) This email address may not be added to any commercial mail list with out my permission. Violation of my privacy with advertising or SPAM will result in a suit for a MINIMUM of $500 damages/incident, $1500 for repeats.

2 2

[BUG] Background processes interfere with Zope's HTTP responses
by Dieter Maurer 20 Dec '00

20 Dec '00

Today was again a hard Zope day. Did you ever hear, that usually (i.e. if you do not do special things) Zope renders a complete page before it starts sending the result back to the client. This implies that you should never see only half of a page. I heard it and I saw the code that does it. Therefore, I was convinced that this were really the case. Then our client phoned: He visits a page that allows him to generate a newsletter. When he presses the "generate newsletter button", a result page is build that tells him that the newsletter is being generated and send is a few minutes. He reported, that this response page is build only half, then stops, to be completed only half a minute later, at the same time when the newsletter arrives. The effect is reproducible. If newsletter generation takes longer, he must wait longer for the page to complete. He is convinced that we generate the newsletter synchronously and let him wait until the generation is complete. And he is angry. I know, that the newsletter is generated in a background process, started in an external method with: os.system("gen_newsletter &") I try to reproduce the behaviour in our test environment and fail. I do not have to wait, until the newsletter generation finished. Then, I use the official service URL and see, I observe the same behaviour. The difference: in the test environment, the browser connects directly to ZServer; with the official URL, it connects via a proxy. Puzzling! What happened? The background process inherits Zope's open file descriptors. Among them are all currently open HTTP request sockets. The process keeps these sockets open until it finishes. There are two HTTP modes: 1. single request mode a new TCP connection is created for each HTTP request, the request is completed, when the TCP connection is closed. 2. multi request mode several requests share a single TCP connection. The "Content-Length" HTTP header allows client and server to determine the request boundaries. That means: when a client uses the multi request mode, everything is fine. Clients, however, that use the single request mode wait until their connection is closed and can observe serious delays. These delays may be very difficult to explain, as the background process not only delays its own request but may delay arbitrary other requests that happen to be served at the same time. How to fix the problem: There should be a (file) control "CloseOnExec", that tells Unix to automatically close the file like object upon an exec. ZServer should probably use it on each of its sockets. I can not see a serious application that should have direct access to ZServer's HTTP request socket. I will soon file a bug report into the Collector. Dieter

2 1

Preliminary test of Membership on CVS
by Bill Anderson 20 Dec '00

20 Dec '00

Just thought I'd give a quick notice regarding Membership. I am trying it out on 2.3 (getting in early :). So far, the only problem lies in LoginManager. With LoginManager, the problem is that it tries to import "Super". in 2.3, Super is gone. It seems to be replaced by UnrestrictedUser. By doing a search and replace on these (there are two instances of it, IIRC), it works fine, almost. It seems that Loginmanager looks for an access file. With the new user system in 2.3, there may not be an access file. I just ran the zpasswd.py file to create the Emergency user, and all went fine. On a related note, I am considering changing the python methods to Python Scripts, this way when 2.3 comes out, it drops the number of additional installs required by one, leaving Loginmanager and ZPatterns the only (current) requirements. Python Scripts eem much better to use than Python Methods anyway ;) Any thoughts on that from the community?

2 2

POST METHOD
by Anderson Ami 19 Dec '00

19 Dec '00

Is there a data limit if I am using the POST method ?I have been doing a form that has some input fields, when I do the post I receive a Zope Error The Zope don´t get one form field, but this one exists). Thanks so much !!! anderson

2 1

Re: [Zope] [BUG] Background processes interfere with Zope's HTTP responses
by jimbo 19 Dec '00

19 Dec '00

> He reported, that this response page is build only > half, then stops, to be completed only half a minute later, Depending on how long the page is I never see the bottom. When I use the products page I have to refresh 2-3 times to see the bottom part. This is thru a proxy only. > > I try to reproduce the behaviour in our test environment > and fail. I do not have to wait, until the newsletter > generation finished. Then, I use the official service > URL and see, I observe the same behaviour. > The difference: in the test environment, the browser > connects directly to ZServer; with the official > URL, it connects via a proxy. > > Puzzling! I'm having this same sort of problem w/Zope 2.3a1. I just started trying to use Zope through a proxy. If I work directly on the machine I have no problems. >How to fix the problem: > > There should be a (file) control "CloseOnExec", that tells > Unix to automatically close the file like object upon > an exec. > ZServer should probably use it on each of its sockets. > I can not see a serious application that should have > direct access to ZServer's HTTP request socket. >I will soon file a bug report into the Collector. >Dieter I'm on the win32 platform and thought that the problem was with my proxy software. Now I'm not so sure. -Jimbo

2 1