- Zope - Zope lists

zope search problems w/squishdot with latin1, locale fi_FI
by Jyrki Kuoppala 27 Mar '00

27 Mar '00

I'm using Zope 2.1.4 on Linux with environment LC_ALL set to fi_FI and Zope started with -L fi_FI, and ZCatalog indexing & searching seems to work fine. (well, there's a problem with some documents having ä etc. spelled out, but if ä is used everything works OK.) BUT, ZDConfera & Squishdot don't work right. For some reason, at some phase of the indexing characters like ö (ö, octal 366) in words are converted to their octal codes. This can be seen by looking at the raw Data.fs file. The result is that when I have a word like kökköviesti in the ZDConfera or Squishdot article, it can be found by search as 366viesti It is converted in the db storing/indexing phase to something like k\366kk\366viesti, which is then broken into words k, 366kk, 366viesti which are stored into the textindex. Any ideas on how to fix this? I've looked at Splitter.c, TextIndex.py, ZDiscussions.py and Squishdot.py, but I can't find anything which would convert characters to their octal codes. //Jyrki

1 0

ZCatalog specificity
by Oleg Broytmann 27 Mar '00

27 Mar '00

---------- Forwarded message ---------- Date: Mon, 27 Mar 2000 12:12:06 +0400 From: bsv <bsv(a)ramax.spb.ru> To: Oleg Broytmann <phd(a)sun.med.ru> Subject: ZCatalog specificity By searching of the documents using ZCatalog, in query I list words with "OR", for example, "web or pop or mail" - all works well. But if in a query with "OR" there is a word that is not in the index, ZCatalog finds nothing, for example, "web or pop or mailvvv", but the documents with "web" and "pop" exist. On www.zope.org the same effect. Is it possible to correct this situation?

1 0

Sorting descending/ascending
by Ken Kinder 27 Mar '00

27 Mar '00

In a dtml-in, how do I explicitly sort ascendingly or descendingly?

4 3

Passing data to/from Python
by Mark Wexler 27 Mar '00

27 Mar '00

Dear Zopistas, I am in the process of learning about Zope, and trying to determine whether to make the switch from pure Python CGI scripts. If someone could answer the following questions (and I apologize, as it will probably seem naive), it would really help. Let's suppose I have a page where the user queries a data base, for instance a telephone directory. The telephone directory is in an Excel file. At present, I have a CGI script that opens an ODBC.Windows connection, executes an SQL query, and outputs the results (names, phone numbers) as an HTML table using "print". What is the best way to do this in Zope? Here are the points that I don't get: 1. It seems that the only way to establish a DB connection is through Gadfly. There are warnings everywhere that Gadfly is inefficient. Therefore, I want to use ODBC (ODBC.Windows), like I did before. How? 2. I might eventually need to do complex calculations on the retrieved data, so I would prefer using Python code in an external method, rather than a DTML method. In order to get Zope to accept the line "import ODBC.Windows", I had to copy the ODBC and DateTime directories from my regular Python installation (PYTHON/lib) to ZOPE/bin/lib. But then, when I try running the script, I get one of the following problems: a. If I go through authentification, the script runs, but I cannot establish the connection to the database. b. If I type in the URL of my search page directly, without authentification, I get a Zope error: "initialization of module mxODBC failed (exceptions.AttributeError:mxDateTimeAPI)". Is my ODBC.Windows installation wrong, or do I have a more fundamental problem? 3. What if my Python function in my external method wants to return information to my DTML method? For instance, how do I return a Python list, and what do I do in my DTML method to process it (e.g., output a line for every member of the list)? 4. The way I call my Python function now is through the <form method="POST" action="search"> tag, where "search" is the external method ID. The form has a field called "name", and my Python function has an argument also called "name", and so it recuperates the string that was entered in the "name" field. Can I pass the "name" as an argument to a DTML method? If these questions have answers, I would really appreciate them. Otherwise, if I'm completely off-base (for instance, if I'm thinking in Python terms and not in Zope terms), please point me in the right direction! Thanks in advance. Mark Wexler

7 7

Midgard vs Zope (Was RE: [Zope] PHP vs Zope)
by Alessandro Bottoni 27 Mar '00

27 Mar '00

Interesting topic! How does Zope compare with Midgard? Which one is more flexible (that is: which one can be used in a wider set of cases)? Which one is easier to learn for the webmaster? Which one is better fit to develop and maintain a complex web site (let's say: 10,000 documents and 50,000 pictures, updated weekly)? Which one is better for web sites that uses database and/or a "fragmented document" architecure (XML/SGML documents that are disassembled and re-assembled on demand)? Which one can better integrate other technologies (web-mail interfaces and so on)? Which one is easier to use for a remote customer, enabled to develop and maintain his pages on the server? Which one is better for "workgroup" intranet servers? Which one is safer (more anti-hacker)? Which features does Zope have that Midgard does not have? Thanks. PS What does "Midgard" mean (I'm italian...)? ---------------------------------------------------------------- Alessandro Bottoni (Alessandro.Bottoni(a)Think3.com) Web Programmer @ Think3 inc. (www.think3.com) I do not speak for think3 and they return the favour > -----Original Message----- > From: Eric W. Sink [SMTP:eric@sourcegear.com] > Sent: Wednesday, March 22, 2000 6:31 AM > To: Nikolai Vladychevski > Cc: zope(a)zope.org > Subject: Re: [Zope] PHP vs Zope > ---- omissis ----- > Compare PHP to Python > > Compare Zope to Midgard. > >

5 5

Problems with adding ZClass instances
by John Morton 27 Mar '00

27 Mar '00

I'm have problems with a ZClass I'm working on that uses Folder as it's base class and is supposed to install a set of default methods when it's created. The trouble is that it won't when the webDirectory is created, but it will when I invoke the same method from a tab afterwards. Here's the body of webDirectory_add: <dtml-with "webDirectory.createInObjectManager(REQUEST['id'], REQUEST)"> <dtml-if createDefaultMethods> <dtml-in "default_methods.objectIds()"> <dtml-try> <dtml-call "manage_delObjects(ids=[_['sequence-item']])"> <dtml-except> </dtml-try> <dtml-call "manage_clone( _.getattr(default_methods, _['sequence-item']), _['sequence-item'], REQUEST)"> </dtml-in> </dtml-if> </dtml-with> I'm assuming that the code within the <dtml-with ...> is effectively opperating in the context of the newly created object, but when the first manage_clone() is executed, it bombs out in _getCopy, tripping over on this line: ob=container._p_jar.importFile(f) ...because whatever container is, it's not a folderish object. So what do I need to do to switch to the new webDirectory object at creation time, so adding methods is automatic? Thanks, John.

1 0

Re: [Zope] Passing data to/from Python
by Curtis Maloney 27 Mar '00

27 Mar '00

On Mon, 27 Mar 2000, Terry Kerr wrote: > Curtis Maloney wrote: > > > 1. It seems that the only way to establish a DB connection is > > > through Gadfly. There are warnings everywhere that Gadfly is > > > inefficient. Therefore, I want to use ODBC (ODBC.Windows), like I > > > did before. How? > > > > > Nonono.... ZOPE uses the Gadfly db to store "zope objects". It can also > > connect to other DBs, and access them via SQL methods. There are a number of > > DB interfaces, including an ODBC interface. > > Umm...no...ZOPE used the ZODB to store objects...gadfly is another SQL written > python that is just bundled with zope since it is pretty cool. > Ok.. my mistake.. sorry.... thanks for correcting me. I was under the impression ZOPE stored data in a db, using gadfly as the default, and it was refered to as ZODB for convenience. Thanks for clearning that up for me. -- Have a better one, Curtis. <dtml-var standard_work_disclaimer>

1 0

Re: [Zope] Performance Testing / Expections
by J. Atwood 27 Mar '00

27 Mar '00

Here are my tests... Machine: 300 MHz 256 RAM IDE Hardrive Apache on same machine (different port) Document Length: 590 bytes Concurrency Level: 25 Time taken for tests: 0.165 seconds Complete requests: 100 Failed requests: 0 Total transferred: 92340 bytes HTML transferred: 63720 bytes Requests per second: 606.06 Transfer rate: 559.64 kb/s received Connnection Times (ms) min avg max Connect: 0 6 14 Processing: 22 25 34 Total: 22 31 48 Zope (ZServer Only, test document, just a few html bits and <dtml-var standard_html_footer>) Document Length: 682 bytes Concurrency Level: 25 Time taken for tests: 2.451 seconds Complete requests: 100 Failed requests: 0 Total transferred: 88500 bytes HTML transferred: 68200 bytes Requests per second: 40.80 Transfer rate: 36.11 kb/s received Connnection Times (ms) min avg max Connect: 0 66 333 Processing: 339 467 342 Total: 339 533 675 I upped it to 1000 and got... Concurrency Level: 25 Time taken for tests: 23.074 seconds Complete requests: 1000 Failed requests: 0 Total transferred: 885885 bytes HTML transferred: 682682 bytes Requests per second: 43.34 Transfer rate: 38.39 kb/s received I put it against a normal page with a lot dtml and a few highly cached sql calls (in DTML's) Document Length: 17000 bytes Concurrency Level: 25 Time taken for tests: 13.314 seconds Complete requests: 100 Failed requests: 0 Total transferred: 1727400 bytes HTML transferred: 1700000 bytes Requests per second: 7.51 Transfer rate: 129.74 kb/s received Connnection Times (ms) min avg max Connect: 0 82 379 Processing: 386 2898 4312 Total: 386 2980 4691 When I turned it on a highly dynamic page (lots of SQL, lots of DTML) It got worse.. Server Hostname: fundraising.gotschool.com Server Port: 80 Document Path: /search?category=11 Document Length: 22373 bytes Concurrency Level: 1 Time taken for tests: 25.820 seconds Complete requests: 100 Failed requests: 73 (Connect: 0, Length: 73, Exceptions: 0) Total transferred: 2263791 bytes HTML transferred: 2236391 bytes Requests per second: 3.87 Transfer rate: 87.68 kb/s received Connnection Times (ms) min avg max Connect: 0 0 2 Processing: 197 257 315 Total: 197 257 317 I upped that cache on the SQL and that id not really help... I then put the test against just one of the parts of the page (that is DTML, calls another DTML and has a SQL Select in it) Concurrency Level: 1 Time taken for tests: 19.768 seconds Complete requests: 100 Failed requests: 0 Total transferred: 987100 bytes HTML transferred: 966700 bytes Requests per second: 5.06 Transfer rate: 49.93 kb/s received Connnection Times (ms) min avg max Connect: 0 0 2 Processing: 151 197 211 Total: 151 197 213 Which was not bad... I upped to a 25 Concurrency... Document Length: 9667 bytes Concurrency Level: 25 Time taken for tests: 15.912 seconds Complete requests: 100 Failed requests: 81 (Connect: 0, Length: 81, Exceptions: 0) Total transferred: 691350 bytes HTML transferred: 670542 bytes Requests per second: 6.28 Transfer rate: 43.45 kb/s received Connnection Times (ms) min avg max Connect: 0 158 718 Processing: 727 3342 4341 Total: 727 3500 5059 Well, that is food for thought today. If anyone has some really good analysis of this (since this is my first time using AB) that would be great. JMA

1 0

dtml-with self
by Ken Kinder 27 Mar '00

27 Mar '00

How do I use dtml-with on the folder it is in? I have a folder with several documents in it, say like this: folderName DocumentA DocumentB and I want to display a summary of documents when the user visits folderName by putting this in folderName's index_html: <dtml-with self> <b><a href="<dtml-var id>"><dtml-var title</a></b> </dtml-with>

2 1

Re: [Zope] zope_msg.log Message
by Cary O'Brien 27 Mar '00

27 Mar '00

> Pavlos Christoforou wrote: > > > > On Fri, 24 Mar 2000, Michel Pelletier wrote: > > > > > > > > > As soon as I'm able to collect more info I'll forward it to you. Is > > > > there anywhere else I should be posting this information? > > > > > > The list. just keep ccing me. > > > > > > > Some good news at last ... > > > > When I set DEBUG in asyncore.py to 1 so I could view the lists going into > > select, ZServer stabilised and hasn't crashed since. Smells like a race > > condition and somehow the extra time it takes to print the list contents > > stabilises things. > > This might be a seperate problem than The Mysterious Segment Violation. > Can race conditions cause SEG faults? , I guess they can like any other > piece of code. but I would expect a race condition to just spin the > process. Can someone who I've spoken with about their SIGSEV problem > reproduce Pavlos' cure? > Wild idea: Do you ever get errors when you try to compile a big, big program, specifically the Linux kernel? It seems as if a large number of seemingly perfectly functioning PCs have memory errors that only show up under specific, not well known access patterns. Compiling a big program is a process that can exhibit these error prone patterns[1][2]. Perhaps Zope under load causes the same access patterns? [1] This is not an urban legend. I have seen it. [2] Search for gcc and signal-11 or sigsegv. There are a couple of web pages out there about this. -- cary (probably wrong) > > Still I cannot understand how the child process causes the supevising > > (zdaemon) process to die too. > > This makes me think it's a different problem also. I get the feeling > you should be able to reproduce this problem on a fresh checkout on your > platform since it's so low level. Can you check that? > > -Michel > > --__--__-- >

3 2