November 1999 - Zope-Dev

Re: [Zope] Can not search the chinese word in ZCtalog using TextIndex
by Sheng Lan 01 Nov '99

01 Nov '99

>From: "Jeff Rush" <jrush(a)timecastle.net> >Reply-To: "Jeff Rush" <jrush(a)timecastle.net> >To: "Sheng Lan" <lansea(a)hotmail.com> >Subject: Re: [Zope] Can not search the chinese word in ZCtalog using >TextIndex >Date: Mon, 01 Nov 99 07:35:49 -0500 > >I don't think Zope supports double-byte chinese text. I do know >that other have asked how to do searches on german and french, >and the answer for both was that the current 2.0.1 release of Zope >truncates characters in the textindex source to 7-bits before searching >or indexing. The Zope people were apologetic and said that the >version of Zope in CVS (version control system) -does- support >german/french -- that they had removed the code that chops to >7-bits. However, I do _not_ know if this change would allow >chinese text or if they have more work to do to handle double >byte text. > >Ask at <support(a)zope.org>. > >-Jeff Rush > > >On Sat, 30 Oct 1999 03:37:13 PDT, Sheng Lan wrote: > > >I read the How-To: Z Catalog Tutorial and test the sample > >( http://www.zope.org/Documentation/How-To/ZCatalogTutorial ) > > > >I create a searchable catalog of CDs,and write some chinese word in > >description field using fulltextindex,but in Z search interface I fill > >description field this chinese word,I can not find any item , I can find >the > >english word. who can help me,thanks > > > > > ______________________________________________________ Get Your Private, Free Email at http://www.hotmail.com

2 1

RE: [Zope-dev] Gadfly, ZODB
by Rob Page 01 Nov '99

01 Nov '99

Sergey wrote: > Would you tell me, please.Zope in operating time holds documents, > methods, products (all that is in ZODB) in memory or reads out in > memory as required. At use Gadfly from Zope all tables Gadfly are > loaded into memory. What quantity of operative memory is necessary > for use Zope, Gadfly? Zope uses an rather robust Object database for the storage of DTML Documents, DTML Methods, ZSQL Methods, etc.. These objects are loaded into real memory when they are needed by the application. They remain in a memory cache for some amount of time until they are retired back to disk. There are configuration parameters in Zope for controlling how large the memory cache is and how aggressively the Z Object Database retires objects out of real memory. Gadfly, on the other hand, is an external product developed by Aaron Watters. It has been included in Zope because it is simple to install and provides a nice out-of-the-box relational database for people to use when first tinkering with Zope. AFAIK, the current incarnation of Gadfly uses real memory for all of its data storage. This _may_ make it unpalatable for use with large databases. (Note -- if the real memory ramifications of suing Gadfly are acceptable, you'll have a pretty fast database...). Finally, the memory requirements of Gadfly are additive with the memory requirements of Zope. As a result, it's easy to incorrectly assume that Zope itself is consuming large amounts of real memory when, in reality, it might be the Gadfly database. I have heard a rumor that a forthcoming version of Gadfly will be able to use disk files for storage. Hope this helps, --Rob P.S. - It's much easier to reply to non-HTML formatted email messages

1 0

Re: [Zope] Can not search the chinese word in ZCtalog using TextIndex
by Sheng Lan 01 Nov '99

01 Nov '99

>From: "Jeff Rush" <jrush(a)timecastle.net> >Reply-To: "Jeff Rush" <jrush(a)timecastle.net> >To: "Sheng Lan" <lansea(a)hotmail.com> >Subject: Re: [Zope] Can not search the chinese word in ZCtalog using >TextIndex >Date: Mon, 01 Nov 99 07:35:49 -0500 > >I don't think Zope supports double-byte chinese text. I do know >that other have asked how to do searches on german and french, >and the answer for both was that the current 2.0.1 release of Zope >truncates characters in the textindex source to 7-bits before searching >or indexing. The Zope people were apologetic and said that the >version of Zope in CVS (version control system) -does- support >german/french -- that they had removed the code that chops to >7-bits. However, I do _not_ know if this change would allow >chinese text or if they have more work to do to handle double >byte text. > >Ask at <support(a)zope.org>. > >-Jeff Rush > > >On Sat, 30 Oct 1999 03:37:13 PDT, Sheng Lan wrote: > > >I read the How-To: Z Catalog Tutorial and test the sample > >( http://www.zope.org/Documentation/How-To/ZCatalogTutorial ) > > > >I create a searchable catalog of CDs,and write some chinese word in > >description field using fulltextindex,but in Z search interface I fill > >description field this chinese word,I can not find any item , I can find >the > >english word. who can help me,thanks > > > > > ______________________________________________________ Get Your Private, Free Email at http://www.hotmail.com

1 0

Gadfly, ZODB
by sergey2b 01 Nov '99

01 Nov '99

Hi, All. Would you tell me, please.Zope in operating time holds documents, methods, products (all that is in ZODB) in memory or reads out in memory as required. At use Gadfly from Zope all tables Gadfly are loaded into memory. What quantity of operative memory is necessary for use Zope, Gadfly? Best regards, Sergey.

1 0

HOWTO: Zclasses based on XML Documents
by Anthony Pfrunder 01 Nov '99

01 Nov '99

[Posted for comment before posting on www.zope.org] This document describes a technique for subclassing XML Documents and adding content modifing functions which work as expected. No patches to XML Document are required and this technique eliminates the following issues / errors: * No aq_* attributes * Invalid / missing _id attribute * Failure of URL and other aquisition-based functions * Double adding of nodes when using insertBefore, AppendChild The document details the creation of a ZClass based on XML Documents but the same comments apply to a python-level Product. Procedure: ---------- 1 - Create a Zclass subclassing from _ZClass_for_XMLDocument 2 - Add a new Python Method which modifies the XML Document content in the new Zclass 3 - Items indicated with a [*] are items where caution is required to avoid the problems above. [Python Method] Parameters: self, REQUEST Body: # Get the first HEAD element of the XML Document. The index [0] ensures that a node and # NOT a NamedNodeList is returned head = self.getElementsByTagName('head')[0] # [*] Create a clone of the HEAD element. Here, the __of__ attribute returns # a clone of the HEAD node with the aquisition path pointing to the Zclass. # The aquisition path now looks like this: # Zclass # +--> head --> <HEAD> # +--> clone --> <HEAD> # This means that the cloned node "belongs" to the same XML Document as the source node. # This is required for content modification to work correctly. Do NOT add __of__ to # other content creation functions within XML Document as it will cause problems clone = head.cloneNode(1).__of__(head.OwnerDocument()) # Create a child element within the clone: <SCRIPT src="<node path>/javascript" # language="javascript"> # [*] Create an empty element called script. This element MUST be created # from the OwnerDocument otherwise it will have a parent_node. This causes problems # because when you add it to the tree it will try to delete itself from the parent_node. # This will fail (giving invalid _id) because it has not been initialised yet. # Initialisation is performed when it is added to a tree. Therefore, create the # element, add it to the tree and THEN modify attributes and add child nodes. # Note, use the node returned from the appendChild function for applying attributes etc NOT # the one returned from the initial createElement. tmp = clone.getOwnerDocument().createElement('script') tmp = clone.insertBefore(tmp, clone.getFirstChild()) tmp.setAttribute('src', self.absolute_url()+'/javascript') tmp.setAttribute('language', 'javascript') tmp.appendChild(tmp.getOwnerDocument().createTextNode('javascript code goes here')) If this Python Method is applied to a node within an XHTML document the following will result: <head> <script src="http://xxx/e123/e236/javascript" language="javascript"> javascript code goes here </script> </head> where e123/e236 is the URL of an exisiting node within the XML Document. Note that because it is CLONED the original content is not changed. Hopefully this will be of help to some people developing XML-based Zclasses. Cheers, Anthony Pfrunder

1 0

Zope container objects can't multitask; Z2 CONFLICT mis-reported
by gtk 01 Nov '99

01 Nov '99

Zope container objects can't multitask. If you try and add more than one item to a folder at a time -- even if they have different ids -- a Z2 CONFLICT error occurs. To add insult to injury, the error message sent to the user seems to be almost random. I've seen both of these: Missing doc string at: http://BEETLEJUICE:8080/folder1 The parameter, <em>id</em>, was omitted from the request. To reproduce the problem, create a folder named /folder1 on your server and run the following code (don't forget to edit the defaults!): # test Zope's ability to add more than one item to a folder simultaneously import httplib, sys, time, urllib, base64, thread, string __defaultServer = '127.0.0.1' __defaultPath = '/folder1' __defaultPort = 8080 __defaultUsername = 'zopeadmin' __defaultPassword = '<your password>' def httpPOST(dict, server, port, path, username, password): """I blame section 4.61 of the Python FAQ.""" postings = [] for key in dict.keys(): postings.append('%s=%s' % (key, urllib.quote(dict[key]))) qs = string.join(postings, '&') userpass = '%s:%s' % (username, password) httpobj = httplib.HTTP(server, port) httpobj.putrequest('POST', path) httpobj.putheader('Accept', '*/*') httpobj.putheader('Connection', 'Keep-Alive') httpobj.putheader('Content-type', 'application/x-www-form-urlencoded') httpobj.putheader('Content-length', '%d' % len(qs)) httpobj.putheader('Authorization', 'Basic %s' % base64.encodestring(userpass)) httpobj.endheaders() httpobj.send(qs) reply, msg, headers = httpobj.getreply() return reply, msg, headers, httpobj.getfile().read() def createDTMLDocument( id, title='', server=__defaultServer, port=__defaultPort, path=__defaultPath, username=__defaultUsername, password=__defaultPassword ): """Create a DTML document""" dict = { 'id': id, 'title': title } return httpPOST(dict, server, port, path + '/manage_addProduct/OFSP/addDTMLDocument', username, password) def Test(numDocs): for intId in range(numDocs): ident = thread.get_ident() id = '%d.%d' % (intId, ident) title = 'concurrency' print 'creating document %s' % id reply, msg, headers, body = createDTMLDocument(id, title) if reply != 302: # I'm expecting a redirect print 'reply status:', reply print headers print body def MultiThreadedTest(numThreads, numDocs): for threadnum in range(numThreads): thread.start_new_thread(Test, (numDocs,) ) # Test(5) MultiThreadedTest(3,3) Regards, Garth. -- <gtk(a)well.com>

3 3

XML Roadmap (Fwd: [XML-SIG] Hello)
by Patrick Phalen 01 Nov '99

01 Nov '99

I'm forwarding a message (below) from the Python XML-SIG list, which raises a few questions about Zope's XML plans. They are interesting questions, which I imagine Digital Creations has already considered, but I don't recall seeing any specific discussion here. I'm sure the XML-SIG folks will be able to address some of these questions, but the DC-related ones should probably come "from the horse's mouth"? ---------- ## Forwarded Message ## ---------- Subject: [XML-SIG] Hello Date: Fri, 29 Oct 1999 11:45:32 +0100 (NFT) From: Vladimir Marangozov <Vladimir.Marangozov(a)inrialpes.fr> Hi all, I'm relatively new to the XML world (which is not the case for Python) as well as the W3C standardization efforts in this area, but as a benevolent INRIA webmaster I have to jump in, so I joined this sig. (finally! :-) and I plan to stay for a while... ;-) I have some comments and a couple of questions that I hope you'll be able to answer. I realize that the information exists somewhere, or I can analyse the code to see what's done or doable and what's not, but I'd better refer to you as more experienced in this area and save some precious time. I'm building a medium-sized website (approx. 150 pages) and I already have some content and a relatively complex layout, all written in valid HTML 4 almost by hand <ouch!>. Continuing this way, as you know, is a dead end. I have been told (and more precisely, the W3C people working here) that I have to put my content in XML, then use XSLT to transform my content and generate the HTML layout. This way, if I want to make radical changes to the layout or the output documents, the only thing I'll have to modify is the transormation rules. I guess that this is not the only solution for my task, but I'd better follow their advice in the long run. So, as a Python addict, I made a quick tour on the Web to see what Python tools exist for the job. The good news is that the XML-SIG has already packaged the low-level machinery of XML -- a very nice piece of work! Another good news is that the FourThought guys have released recently parts of their 4Suite, including the XSLT and XPath packages. I haven't tried them yet, so I'm not in a position to comment whether the implemented subset of the W3C recommendation (PR-xslt-19991008) will suffice for my task. (I can only regret that James Clark's XT was written in Java, and not in Python. I'll tell Vincent Quint to convert him ;-) A third good thing is Zope. I won't comment too much on it because you already know better than me what Zope is and does. What bothers me a little bit in Zope is that I'm not convinced that I can clearly separate content from style. Zope relies on templates, not on transformation rules. So, I wonder whether I really have today the Python basic bricks to perform the following: 0) Define my DTD and deduce the user-friendly forms for 1). 1) Fill my content via user-friendly forms (a la Zope) 2) This content is wrapped and stored in XML. 3) The XML files are processed according to my stylesheets and the XSLT processor. 4) The formatted result (currently in valid HTML 4.0) shines on my screen (when I click on Zope's preview, for example) Basically, I'd like to "plug" the XML/XSLT part in the Zope site-building process. Fundamentally, Zope's DTML resembles XSLT, but as an INRIA employee, I tend to prefer XSLT and the standards my colleages are working on ;-). In the end, is this doable? Are there any missing parts or tools in this chain? I wish that the people at DC consider a strategical move for Zope, so that this excellent product incorporates (or is interfaced with) the W3C standards. Damn, even the examples in Zope are not in valid HTML! DTML is good (it was developped before the current standards), but a shift or a bidirectional converter DTML<->XSL/T would be a major win. Whether this is doable is another story. I don't know too much of the details yet, but I plan to get at full speed shortly :-) -- Vladimir MARANGOZOV | Vladimir.Marangozov(a)inrialpes.fr http://sirac.inrialpes.fr/~marangoz | tel:(+33-4)76615277 fax:76615252 _______________________________________________ XML-SIG maillist - XML-SIG(a)python.org http://www.python.org/mailman/listinfo/xml-sig -------------------------------------------------------

5 5