- Zope - Zope lists

Re: [Zope] Questions on ZODB BTrees versus bsddb BTrees
by Terry Jones 05 May '06

05 May '06

[Following up on my original posting, with a summary of resolution.] Thanks for the help & pointers to ZCatalog. I actually did find a standalone version of ZCatalog, created by Kevin Dangoor, at http://www.blazingthings.com/dev/zcatalog.html His pulls code out of Zope3, and rewrites some of it. Kevin's code and one example each requires one trivial change to work on the current Zope3 SVN version (email me if you need these). I read the plope chapter on ZCatalog, but its emphasis is on getting at ZCatalog from zope, whereas I want to do everything from python, with no zope instance. Meanwhile, I had decided that my option #3 | 3. Redesign what I'm doing so as to only need ZODB BTrees. This is quite | far from optimal (in terms of space and time), but might be the | quickest to implement. | | However, this may not solve the problem. If a fundamental need is to | (e.g.) find all values >= X, where duplicates are allowed but you're | using trees that do not allow duplicate keys, this is difficult. Hence | the question about byValue(). actually wasn't too hard, and that I should simply store values as keys and let values be a list of objects that had that value. (I hope that makes sense) Then, finally reading the Zope3 src/zope/app/catalog/README.txt I saw that that is basically what ZCatalog already does (except with a BTrees.IFBTree.IFTreeSet not a list), as well as adding indexing. That solution wastes space, as values are stored twice. How much of a waste depends on the multiplicity of value values, but it could about a 2x waste (i.e., when all values are distinct and their size is large compared to the size of an docid). And there's more pickling, and more traffic to the storage. But.... that's life I guess. I'd rather the simpler, easier solution that lies wholly within ZODB/ZEO and which lets me have just a single transaction and recovery type to worry about than to hack a hybrid ZODB/bsddb just to save space and have to deal with those issues in a robust way. So that's it, problem solved. Thanks again for the pointer to ZCatalog. Terry

1 0

how to decode base64 in DTML?
by Jaroslav Lukesh 04 May '06

04 May '06

Hi all, Would you like to help me with decoding base64 string, please? I was try many ways (*), but no with success, but import cStringIO import mimetools import binascii binascii.a2b_base64('YWxla2liYW5nb0B6dWcuY3o=\n') in commandline python works OK. (*)here are some examples: <dtml-var "_.base64.decode('YWxla2liYW5nb0B6dWcuY3o=\n')"> <dtml-var "_base64.decode('YWxla2liYW5nb0B6dWcuY3o=\n')"> <dtml-var "base64.decode('YWxla2liYW5nb0B6dWcuY3o=\n')"> <dtml-var "'YWxla2liYW5nb0B6dWcuY3o=\n'.base64.decode()"> <dtml-var "mimetools.base64.decode('YWxla2liYW5nb0B6dWcuY3o=\n')"> <dtml-var "_mimetools.base64.decode('YWxla2liYW5nb0B6dWcuY3o=\n')"> <dtml-var "_.mimetools.base64.decode('YWxla2liYW5nb0B6dWcuY3o=\n')"> <dtml-var "_.base64.decodestring('YWxla2liYW5nb0B6dWcuY3o=\n')"> <dtml-var "mimetools.base64.decodestring('YWxla2liYW5nb0B6dWcuY3o=\n')"> <dtml-var "_mimetools.base64.decodestring('YWxla2liYW5nb0B6dWcuY3o=\n')"> <dtml-var "_.mimetools.base64.decodestring('YWxla2liYW5nb0B6dWcuY3o=\n')"> <dtml-var "_.binascii.a2b_base64('YWxla2liYW5nb0B6dWcuY3o=\n')"> <dtml-var "_binascii.a2b_base64('YWxla2liYW5nb0B6dWcuY3o=\n')"> <dtml-var "binascii.a2b_base64('YWxla2liYW5nb0B6dWcuY3o=\n')"> <dtml-var "_.a2b_base64('YWxla2liYW5nb0B6dWcuY3o=\n')"> <dtml-var "_a2b_base64('YWxla2liYW5nb0B6dWcuY3o=\n')"> <dtml-var "a2b_base64('YWxla2liYW5nb0B6dWcuY3o=\n')"> <dtml-var "'YWxla2liYW5nb0B6dWcuY3o=\n'.binascii.a2b_base64()"> <dtml-var "'YWxla2liYW5nb0B6dWcuY3o=\n'.a2b_base64()"> <dtml-var "_.binascii('YWxla2liYW5nb0B6dWcuY3o=\n').a2b_base64()"> <dtml-var "_binascii('YWxla2liYW5nb0B6dWcuY3o=\n').a2b_base64()"> <dtml-var "binascii('YWxla2liYW5nb0B6dWcuY3o=\n').a2b_base64()"> Many thanks for your help, JL.

5 6

about restricting addable types in Plone
by Sergio Gomez 04 May '06

04 May '06

Hi all, I am working with Plone 2.1.2, Zope 2.8.6 and python 2.3.5. I would like to know if there is a way to restrict addable types to a folderish object programmatically. What I need is to allow adding a certain type of items and not otheres depending on the value of one field in my folderish object. For example, if the value of the field is "0", I can only add "News Item", if the value is "1", I can only add "File", and so on. Thanks! Sergio

2 1

Re: [Zope] Questions on ZODB BTrees versus bsddb BTrees
by Terry Jones 04 May '06

04 May '06

Hi Jonathan >>>>> "Jonathan" == Jonathan <dev101(a)magma.ca> writes: Jonathan> This usage scenario can easily be implemented using ZCatalog (as Jonathan> Chris mentioned) - check the ZopeBook for info. Thanks, that sounds good. Without meaning to whine, I hope it's easier to use than it is to actually find and download ZCatalog :-) I've just spent 20 minutes trying to do this, without success. So if someone has a URL for a ZCatalog download, I'd be happy to receive it. Here are the things I tried: - Google(zope ZCatalog). This got me to http://www.zope.org/Documentation/How-To/ZCatalogTutorial which has an overview (that sounds good), but does not tell me where to download. - I read one-by-one through each of 15 really poorly formatted pages summarizing 300 Zope products. These were claimed to be sorted alphabetically, but they certainly are not. Clicking on the title column did rearrange them, but not into sorted or reverse-sorted order. - I used the search box on the www.zope.org site and the results were dismal. - I looked in the source tarball of recent Zope 2 & 3 releases. - Add "download" to the above google, followed a few links, gave up :-) Anyway, thanks again. Terry

2 1

Questions on ZODB BTrees versus bsddb BTrees
by Terry Jones 04 May '06

04 May '06

I've just read the ZODB/ZEO Programming Guide (Release 3.6.0, A.M. Kuchling, January 5, 2006) and I'd like to ask a few questions. Are the following all correct? - The BTrees supported by ZODB have nothing to do with Berkeley DB Btrees (apart from the fact that they're both implementations of BTrees). - ZODB BTrees do not allow duplicate keys (a la bsddb). - ZODB BTrees do not allow you to set up secondary keys (a la bsddb). And: - Is the byValue() ZODB BTree method officially deprecated? Scheduled for deprecation / removal? - Does byValue() use any kind of secondary index structure, or does it walk the whole tree? I guess the latter, seeing as to implement the former you'd ideally like something like a BTree allowing duplicate keys... Assuming the first three above are correct, and that I would like both duplicate keys and secondary keys in an application with ZODB-like transparent persistent object storage, it looks like I have the following options: 1. Use both ZODB and bsddb in the same application, dealing with things like locking and transactions across both object types in a somewhat manual way. This would have the additional major downside of making it harder to use ZEO for storage, right? (Yes, I could pickle the entire bsddb databases and hand them to ZEO, but that's not really what I had in mind.) 2. Try to add support for bsddb BTrees (with duplicate keys) to ZODB. I guess this is feasible, but it looks like it would make for some fundamental changes, as you would no longer have the dictionary-like interface to the keys of such a BTree. I guess this option would take a serious of work (which may not even be wanted by the ZODB maintainers). 3. Redesign what I'm doing so as to only need ZODB BTrees. This is quite far from optimal (in terms of space and time), but might be the quickest to implement. However, this may not solve the problem. If a fundamental need is to (e.g.) find all values >= X, where duplicates are allowed but you're using trees that do not allow duplicate keys, this is difficult. Hence the question about byValue(). If someone with more knowledge of ZODB and the BTrees therein and bsddb feels like confirming, correcting, or commenting on the above summary, and options, that would be great. Regards, Terry

2 1

about Zope 2.8.6
by BKJ＠telefonica.net 04 May '06

04 May '06

Hello! I have a question about Zope. I'm using Zope 2.8.6-final, python 2.3.5 and Plone 2.1.2. I'm trying to show an event in the portal calendar (CMFCalendar 1.5.5). This event has a custom workflow. I've configured the states in /site/portal_calendar/ ,configure tab, but the calendar doesn't show my event. I have done this experiment with Zope 2.8.1-final and it works well. Is there any problem with Zope 2.8.6 and the CMFCalendar 1.5.5? TERRA -->

2 1

DTML-In with filter
by Martin Koekenberg 04 May '06

04 May '06

Hello, Is it possible to use a DTML-In to display all DTML Documents in a folder exept the one's with a centain value in a property ? Example. DTML Document one with property a=bc DTML Document two with property a=de DTML Document three with property a=bc Now I want to use DTML-IN to display all the dtml documents except the ones with property a=de. I also use the size and batchsize property to create links to the next 10 documents..... If I use an if statement the next 10 can be 9 ore less 9 items because there could be one ore more documents with a=de. Who can help me ? regards, Martin Koekenberg

7 8

Zeo as a Zeo Client
by Gerhard Schmidt 04 May '06

04 May '06

Hallo, I am trying to install a setup like shown below ZEO_M | -- ZEO_B | | -- ZOPE | | -- ZOPE | | -- ZOPE | ... | -- ZOPE | -- ZOPE ... The ZEO_B should be a zeoclient of the ZEO_M (MainZEO). The reason for this setup ist that the ZEO_B is located in a backup computing center on the other side of our campus. When I configured the ZEO_B as a zeoclient of the ZEO_M. I comes up without problem. I've connected the first client, the connection is establisched but the server never come up. Here is the log from ZEO_B level debug 2006-05-02T08:21:45 BLATHER ZEO.zrpc (65280) connect from ('10.152.64.1', 54853): <ManagedServerConnection ('10.152.64.1', 54853)> ------ 2006-05-02T08:21:45 INFO ZEO.zrpc.Connection(S) (10.152.64.1:54853) received handshake 'Z303' ------ 2006-05-02T08:21:45 DEBUG ZEO.zrpc.Connection(S) (10.152.64.1:54853) calling getAuthProtocol() ------ 2006-05-02T08:21:45 DEBUG ZEO.zrpc.Connection(S) (10.152.64.1:54853) getAuthProtocol returns None ------ 2006-05-02T08:21:45 DEBUG ZEO.zrpc.Connection(S) (10.152.64.1:54853) calling register('main', False) ------ 2006-05-02T08:21:45 DEBUG ZEO.zrpc.Connection(S) (10.152.64.1:54853) register returns None ------ 2006-05-02T08:21:45 DEBUG ZEO.zrpc.Connection(S) (10.152.64.1:54853) calling get_info() ------ 2006-05-02T08:21:45 DEBUG ZEO.zrpc.Connection(S) (10.152.64.1:54853) get_info returns {'supportsVersions': 1, 'name': 'main (connected)', 'length'... ------ 2006-05-02T08:21:45 DEBUG ZEO.zrpc.Connection(S) (10.152.64.1:54853) calling endZeoVerify() ------ 2006-05-02T08:21:45 DEBUG ZEO.zrpc.Connection(S) (10.152.64.1:54853) calling loadEx('\x00\x00\x00\x00\x00\x00\x00\x00', '') here is the log for the zope server on ZEO_B 2006-05-02 08:21:45 INFO ZEO.ClientStorage (65292) ClientStorage (pid=65292) created RW/normal for storage: 'main' 2006-05-02 08:21:45 INFO ZEO.cache reusing persistent cache file '/data/zope/console28/var/frontend-main.zec' 2006-05-02 08:21:45 INFO ZEO.ClientStorage (65292) Testing connection <ManagedClientConnection ('10.152.64.1', 8110)> 2006-05-02 08:21:45 INFO ZEO.zrpc.Connection(C) (10.152.64.1:8110) received handshake 'Z303' 2006-05-02 08:21:45 INFO ZEO.ClientStorage (65292) Server authentication protocol None 2006-05-02 08:21:45 INFO ZEO.ClientStorage (65292) Connected to storage: ('10.152.64.1', 8110) 2006-05-02 08:21:45 INFO ZEO.ClientStorage (65292) Verifying cache 2006-05-02 08:21:45 INFO ZEO.ClientStorage (65292) Waiting for cache verification to finish 2006-05-02 08:21:45 INFO ZEO.ClientStorage (65292) Waiting for cache verification to finish 2006-05-02 08:21:45 INFO ZEO.ClientStorage (65292) endVerify finishing 2006-05-02 08:21:45 INFO ZEO.ClientStorage (65292) endVerify finished ^C2006-05-02 08:22:09 INFO ZEO.ClientStorage (65292) Disconnected from storage: "('10.152.64.1', 8110)" Traceback (most recent call last): File "/usr/local/www/Zope28/lib/python/Zope2/Startup/run.py", line 56, in ? run() File "/usr/local/www/Zope28/lib/python/Zope2/Startup/run.py", line 21, in run starter.prepare() File "/usr/local/www/Zope28/lib/python/Zope2/Startup/__init__.py", line 98, in prepare self.startZope() File "/usr/local/www/Zope28/lib/python/Zope2/Startup/__init__.py", line 257, in startZope Zope2.startup() File "/usr/local/www/Zope28/lib/python/Zope2/__init__.py", line 47, in startup _startup() File "/usr/local/www/Zope28/lib/python/Zope2/App/startup.py", line 57, in startup DB = configuration.dbtab.getDatabase('/', is_root=1) File "/usr/local/www/Zope28/lib/python/DBTab/DBTab.py", line 96, in getDatabase db = self._createDatabase(name, is_root) File "/usr/local/www/Zope28/lib/python/DBTab/DBTab.py", line 113, in _createDatabase db = factory.open() File "/usr/local/www/Zope28/lib/python/Zope2/Startup/datatypes.py", line 163, in open DB = self.createDB() File "/usr/local/www/Zope28/lib/python/Zope2/Startup/datatypes.py", line 160, in createDB return ZODBDatabase.open(self) File "/usr/local/www/Zope28/lib/python/ZODB/config.py", line 103, in open version_cache_size=section.version_cache_size) File "/usr/local/www/Zope28/lib/python/ZODB/DB.py", line 239, in __init__ storage.load(z64,'') File "/usr/local/www/Zope28/lib/python/ZEO/ClientStorage.py", line 746, in load return self.loadEx(oid, version)[:2] File "/usr/local/www/Zope28/lib/python/ZEO/ClientStorage.py", line 769, in loadEx data, tid, ver = self._server.loadEx(oid, version) File "/usr/local/www/Zope28/lib/python/ZEO/ServerStub.py", line 192, in loadEx return self.rpc.call("loadEx", oid, version) File "/usr/local/www/Zope28/lib/python/ZEO/zrpc/connection.py", line 531, in call r_flags, r_args = self.wait(msgid) File "/usr/local/www/Zope28/lib/python/ZEO/zrpc/connection.py", line 638, in wait asyncore.poll(delay, self._singleton) File "/usr/local/lib/python2.4/asyncore.py", line 122, in poll r, w, e = select.select(r, w, e, timeout) KeyboardInterrupt I started it with runzope and killed it with CRTL-c. I had it once waiting for 2 hours without any difference. here is the ZEO_B config file # ZEO configuration file %define INSTANCE /data/zope/zeoproxy01 <zeo> address 8110 read-only false invalidation-queue-size 100 # pid-filename $INSTANCE/var/ZEO.pid # monitor-address PORT # transaction-timeout SECONDS </zeo> <zeoclient main> server 10.152.64.1:8100 storage main name main # var $INSTANCE/var # client zeoproxy01 # cache-size 600MB </zeoclient> <eventlog> level debug <logfile> path $INSTANCE/log/zeo.log </logfile> </eventlog> <runner> program $INSTANCE/bin/runzeo socket-name $INSTANCE/etc/zeo.zdsock daemon true forever false backoff-limit 10 exit-codes 0, 2 directory $INSTANCE default-to-interactive true # user zope python /usr/local/bin/python zdrun /usr/local/www/Zope28/lib/python/zdaemon/zdrun.py # This logfile should match the one in the zeo.conf file. # It is used by zdctl's logtail command, zdrun/zdctl doesn't write it. logfile $INSTANCE/log/zeo.log </runner> The Zope Server directly on ZEO_M works without problems. Regards Estartu ---------------------------------------------------------------------------- Gerhard Schmidt | Nick : estartu IRC : Estartu | Fischbachweg 3 | | PGP Public Key 86856 Hiltenfingen | EMail: estartu(a)augusta.de | on request Germany | |

9 24

strange behaviour:can not access source-view.gif but a copy of it
by robert rottermann 03 May '06

03 May '06

Hi there, in a plone site (but I see nothing plone related with my problem) I can not access an image with the id view-source.gif (it is used by kupu). when I copied it to the plone root the copy was named copy_of_view-source.gif all tough no prior object of that name existed. After renaming to view-source.gif and trying to access it trough its URL www.xxx.yy/view-source.gif nothing happens, only the watch is spinning to tell that the browser is still busy. if I copy that very same image to an other name, the copy can be accessed without problems. Can anybody give me a hint what the reason could be, or give me an idea how to hunt it down. thanks robert

3 3

Re: apache rewrite rules brake plone/zope
by Sascha Welter 03 May '06

03 May '06

(Wed, May 03, 2006 at 09:21:47AM -0400) zope-request(a)zope.org wrote/schrieb/egrapse: > From: "David Bear" <dwbear75(a)gmail.com> > Subject: [Zope] apache rewrite rules brake plone/zope > I have the following rewrite rules for apache. The intent is all urls that > have http://myhost/z2 in them will be redirected/rewritten by apache to the > zope instance running on local host. > > RewriteRule ^/z2/(.*) > http://127.0.0.1:9080/VirtualHostBase/http/%{HTTP_HOST}:80 > /VirtualHostRoot/$1 [L,P] Please just go to http://betabug.ch/zope/witch and get a set of proper rewrite rules for this simple case of "inside out hosting". Or read the VHM documentation and learn the inside outs yourself :-) To me it looks like you forgot the _vh_z2 part, but I stopped bothering to debug rewrite rules, since the witch spits them out just fine. > RewriteRule ^/z2dav/(.*) > http://127.0.0.1:9081/VirtualHostBase/https/%{HTTP_HOST > }:443/VirtualHostRoot/$1 [L,P] Likely the same here. > RewriteRule ^/login_form(.*) https://%{HTTP_HOST}/login_form$1 [NE,L] This one has no connection, as it is a redirect. > There is something that I've left out becuase any attempts to view the plone > site through apache are 'messed up', ie the graphics, fonts, style sheets, > etc, are not included in the web page. Only some of the content in rendered > in the browser. However, when I open the url http://127.0.0.1:9080/ the zope > and plone site all works. > > any hints on a rule I've left out? Links "back" to images and CSS failing are a common symptom of a RewriteRule now being correct in respect to the work the VHM does. Regards, Sascha

1 0