- Zope - Zope lists

RE: [Zope] Controlling caching of objects
by Bjorn Stabell 23 Oct '03

23 Oct '03

> From: Toby Dickenson [mailto:tdickenson@geminidataloggers.com] > 15k objects sounds like alot for a catalog query. > > 0.5G/15k = average 33k per object...... that sounds more like > the size of a document object rather than a btree node. > > Both of these facts suggest you might be able to improve > performance by > optimising your application. There are pages in control panel > that will tell you what these 15k objects are. I've been trying to figure that out (hence my other post about browsing the ZODB). Actually, 15,000 target objects per thread. The actual number of objects in memory with 4 threads is around 60,000, so it's more like 8kb per object. Which makes me wonder... [ Sorry for asking so much today, but this is really useful :) ] So you should really try to make sure the entire catalog could fit in memory, or each catalog query will result in activating/deactivating (thrashing) objects? What impacts the amount of memory a catalog query actually uses? The indexes, all of them, loaded in memory? Or only the indexes you use? Or something else? I guess the metadata and the objects themselves won't be touched. Thanks for the clarifying answers, by the way! Regards, -- Bjorn

2 1

cmfoodocument
by johan 23 Oct '03

23 Oct '03

Hi, I have CMFoodocument working on plone 1.04 with Zope 2.6.1. with cmfoodocument 0.1.4, libxslt-1.0.33, libxml2-2.6.0, libxml2-python-2.6.0. The problem is that I cannot see the images of the uploaded openoffice documents, when I try to open the images, I see error : Forbidden You don't have permission to access /doc/Pictures/2000000A0000283200001FBA39B9E377.svm on this server. Is there a way how I can fix this ? Greetings, Johan

1 0

ZCatalog and the LocalContent object
by Ruth Mizzi 23 Oct '03

23 Oct '03

Sorry I'm resending cos I forgot to add a subject line before ... Is there a succesful way of indexing LocalContent objects in ZCatalog. I'm currently using LocalContent (part of Localizer) to provide a multi-language feature on my web site. The only problem is that when I try to find LocalContent objects to catalog them none of the content is being indexed... any solution? Ruth

1 0

(no subject)
by Ruth Mizzi 23 Oct '03

23 Oct '03

Hi, Is there a succesful way of indexing LocalContent objects in ZCatalog. I'm currently using LocalContent (part of Localizer) to provide a multi-language feature on my web site. The only problem is that when I try to find LocalContent objects to catalog them none of the content is being indexed... any solution? Ruth

1 0

RE: [Zope] Controlling caching of objects
by Bjorn Stabell 23 Oct '03

23 Oct '03

> -----Original Message----- > From: Toby Dickenson [mailto:tdickenson@geminidataloggers.com] [...] > The right term is "deactivate". The main reason for > deactivating an object is > that the total number of objects exceeds the per-thread > limit. There are other reasons. Is object cache/memory shared between threads, or is it per thread? If that's the case, is there any reason to limit the number of threads in order to conserve memory? (I read this tip in an old discussion thread somewhere.) If that's not the case, why isn't it the case? It sounds very wasteful in terms of memory use. -- Bjorn

2 1

Zope-2.6.2 traceback
by Arenz, Ralph 23 Oct '03

23 Oct '03

Hi, although i started zope with the -D option there is no traceback in the error message in case of an error. Of course i can expand the standard error message with an "<dtml-var error_tb>" but is that the right way, i guess not ?! Any ideas? regards Ralph

3 2

access to old revisions of objects, even deleted ones
by Sam Brauer 22 Oct '03

22 Oct '03

I have a need to access all revisions of objects of a certain type in my ZODB. It is straightforward enough to find all currently existing instances and then access each one's history. The problem with that approach is that it misses objects that have been deleted (but could still be brought back by an undo operation). Does anyone know a solution? I saw a thread in the ZODB-dev archive (http://aspn.activestate.com/ASPN/Mail/Message/zodb-dev/1414727) where Greg Ward of the MEMS Exchange offers a script that attempts to access all OIDs from zero up to DB.objectCount(), but for my ZODB it ran forever (apprently objectCount() returned a number greater than the actual number of objects in the storage). Later in that thread, Jeremy Hylton suggests that one can use the _index attribute of a FileStorage to obtain a list of existing OIDs, but other storages don't necessarily have _index, and I'd prefer to write something that will work with any undoable storage. Many thanks in advance, Sam Brauer ps. Maybe this message would be better posted on the ZODB list... I just thought I'd try the general list first.

2 2

RE: [Zope] Zope hangs hangs hangs...
by Jim Kutter 22 Oct '03

22 Oct '03

I had the same problems in RH9. After setting my threads to 1, and the interval check timer to 22 (pystones/250), the problem seemed to go away. It's a dedicated development box, so it's not heavily taxed - you may not be able to get away with the same settings I did... -jim -----Original Message----- From: zope-bounces+jim=ebizq.net(a)zope.org [mailto:zope-bounces+jim=ebizq.net@zope.org] On Behalf Of Jakub Wisniowski Sent: Wednesday, October 22, 2003 6:44 AM To: zope(a)zope.org Subject: [Zope] Zope hangs hangs hangs... Hi I'm experiencing some problems with my Zope. It is Zope 2.6.0 sitting on RedHat and connected to Oracle DB via DCOracle. The problem is that sometimes Zope hangs. There are tens of users in my app, and there are also some long lasting db queries, so I have total number of zope threads set to 15 and zodb cache poool size set to 25. But there is no rule (I can't find any rule) for hanging like heavy load or sth - it just happens. This is pretty mysterious for me, because there is nothing in event log except a series of conflict errors, then: 2003-10-21T12:39:18 INFO(0) ZODB conflict error at addr (481 conflicts since startup at 2003-10-21T02:00:05) ------ 2003-10-21T12:39:24 INFO(0) ZODB conflict error at addr2 (482 conflicts since startup at 2003-10-21T02:00:05) ------ 2003-10-21T12:39:26 INFO(0) ZODB conflict error at addr3 (483 conflicts since startup at 2003-10-21T02:00:05) ------ <-- Zope hanging here 2003-10-21T12:56:34 INFO(0) Z2 Caught signal SIGTERM <-- restart here ------ 2003-10-21T12:56:34 INFO(0) Z2 Closing all open ZODB databases ------ 2003-10-21T12:56:34 INFO(0) Z2 Shutting down and then system start informations. In z2.log there is also a pause in requests - it looks like: 127.0.0.1 - Anonymous [21/Oct/2003:12:40:35 +0200] "GET /addr HTTP/1.1" 302 339 "" "Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)" 127.0.0.1 - Anonymous [21/Oct/2003:12:56:40 +0200] "GET /addr HTTP/1.1" 302 339 "" "Mozilla/4.0 (compatible; MSIE 5.5; Windows 98)" And most descriptive detailed log: Start WIn WOut WEnd Tot S OSize Code Act URL 2003-10-21T12:39:42 0 1 0 1 E 21690 200 0 urls 2003-10-21T12:39:42 0 0 0 0 E 282 302 0 ... 2003-10-21T12:39:45 0 0 0 0 E 14318 200 0 ... 2003-10-21T12:39:46 0 2 0 2 E 58170 200 2 ... 2003-10-21T12:39:46 0 5 0 5 E 21743 200 4 2003-10-21T12:39:48 0 NA NA 0 I NA NA 152 urls 2003-10-21T12:39:50 0 1 0 1 E 13904 200 1 ... 2003-10-21T12:39:50 0 13 0 13 E 101528 200 9 ... 2003-10-21T12:39:50 0 13 0 13 E 101528 200 11 ... 2003-10-21T12:39:51 0 1 0 1 E 1790 200 1 ... 2003-10-21T12:39:52 0 0 0 0 E 26499 200 0 ... 2003-10-21T12:39:53 0 0 0 0 E 7728 302 0 2003-10-21T12:39:53 0 1 0 1 E 14049 302 0 2003-10-21T12:39:53 0 4 0 4 E 84388 200 2 2003-10-21T12:39:54 0 1 0 1 E 18137 200 0 2003-10-21T12:39:57 0 1 0 1 E 11716 200 1 urls 2003-10-21T12:39:58 0 1 0 1 E 18322 302 0 ... 2003-10-21T12:39:59 0 3 0 3 E 15407 200 0 ... 2003-10-21T12:40:03 0 1 0 1 E 26706 200 1 2003-10-21T12:40:04 0 NA NA 0 I NA NA 138 urls 2003-10-21T12:40:05 0 NA NA 0 I NA NA 137 ... 2003-10-21T12:40:05 0 1 0 1 E 8084 200 2 ... 2003-10-21T12:40:05 0 2 0 2 E 14568 302 2 ... 2003-10-21T12:40:06 0 NA NA 0 I NA NA 134 ... 2003-10-21T12:40:07 0 NA NA 0 I NA NA 133 ... 2003-10-21T12:40:08 0 NA NA 0 I NA NA 132 ... 2003-10-21T12:40:12 0 NA NA 0 I NA NA 131 ... 2003-10-21T12:40:14 0 NA NA 0 I NA NA 130 2003-10-21T12:40:18 0 NA NA 0 I NA NA 129 2003-10-21T12:40:32 0 NA NA 0 I NA NA 126 2003-10-21T12:40:32 0 NA NA 0 I NA NA 127 2003-10-21T12:40:32 0 NA NA 0 I NA NA 128 2003-10-21T12:40:34 0 1 0 1 E 339 302 0 2003-10-21T12:40:37 0 NA NA 0 I NA NA 124 2003-10-21T12:40:39 0 NA NA 0 I NA NA 123 2003-10-21T12:40:41 0 NA NA 0 I NA NA 122 2003-10-21T12:40:43 0 NA NA 0 I NA NA 121 2003-10-21T12:40:45 0 NA NA 0 I NA NA 119 2003-10-21T12:40:45 0 NA NA 0 I NA NA 120 ... ... ... 2003-10-21T12:55:25 0 NA NA 0 I NA NA 4 urls 2003-10-21T12:55:49 0 NA NA 0 I NA NA 3 ... 2003-10-21T12:55:52 0 NA NA 0 I NA NA 2 ... 2003-10-21T12:56:03 0 NA NA 0 I NA NA 1 ... 2003-10-21T12:56:09 0 NA NA 0 I NA NA 0 ... 2003-10-21T12:56:37 NA NA NA 0 U NA NA 0 System startup 2003-10-21T12:56:40 0 0 0 0 E 339 302 0 urls 2003-10-21T12:56:41 0 0 0 0 E 873 302 1 ... 2003-10-21T12:56:41 0 0 0 0 E 339 302 0 ... 2003-10-21T12:56:41 0 0 0 0 E 873 302 0 ... 2003-10-21T12:56:41 0 0 0 0 E 1672 500 0 ... What can I read from these? Is any of these logs descriptive enough to say what is wrong with my Zope? How to do more investigation? I've got some more Zope instances that works perfectly stable in similar configuration but not with Oracle database, maybe this is a source of these hangs? Thanks -- Jakub Wisniowski _______________________________________________ Zope maillist - Zope(a)zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )

2 1

Zope hangs hangs hangs...
by Jakub Wisniowski 22 Oct '03

22 Oct '03

Hi I'm experiencing some problems with my Zope. It is Zope 2.6.0 sitting on RedHat and connected to Oracle DB via DCOracle. The problem is that sometimes Zope hangs. There are tens of users in my app, and there are also some long lasting db queries, so I have total number of zope threads set to 15 and zodb cache poool size set to 25. But there is no rule (I can't find any rule) for hanging like heavy load or sth - it just happens. This is pretty mysterious for me, because there is nothing in event log except a series of conflict errors, then: 2003-10-21T12:39:18 INFO(0) ZODB conflict error at addr (481 conflicts since startup at 2003-10-21T02:00:05) ------ 2003-10-21T12:39:24 INFO(0) ZODB conflict error at addr2 (482 conflicts since startup at 2003-10-21T02:00:05) ------ 2003-10-21T12:39:26 INFO(0) ZODB conflict error at addr3 (483 conflicts since startup at 2003-10-21T02:00:05) ------ <-- Zope hanging here 2003-10-21T12:56:34 INFO(0) Z2 Caught signal SIGTERM <-- restart here ------ 2003-10-21T12:56:34 INFO(0) Z2 Closing all open ZODB databases ------ 2003-10-21T12:56:34 INFO(0) Z2 Shutting down and then system start informations. In z2.log there is also a pause in requests - it looks like: 127.0.0.1 - Anonymous [21/Oct/2003:12:40:35 +0200] "GET /addr HTTP/1.1" 302 339 "" "Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)" 127.0.0.1 - Anonymous [21/Oct/2003:12:56:40 +0200] "GET /addr HTTP/1.1" 302 339 "" "Mozilla/4.0 (compatible; MSIE 5.5; Windows 98)" And most descriptive detailed log: Start WIn WOut WEnd Tot S OSize Code Act URL 2003-10-21T12:39:42 0 1 0 1 E 21690 200 0 urls 2003-10-21T12:39:42 0 0 0 0 E 282 302 0 ... 2003-10-21T12:39:45 0 0 0 0 E 14318 200 0 ... 2003-10-21T12:39:46 0 2 0 2 E 58170 200 2 ... 2003-10-21T12:39:46 0 5 0 5 E 21743 200 4 2003-10-21T12:39:48 0 NA NA 0 I NA NA 152 urls 2003-10-21T12:39:50 0 1 0 1 E 13904 200 1 ... 2003-10-21T12:39:50 0 13 0 13 E 101528 200 9 ... 2003-10-21T12:39:50 0 13 0 13 E 101528 200 11 ... 2003-10-21T12:39:51 0 1 0 1 E 1790 200 1 ... 2003-10-21T12:39:52 0 0 0 0 E 26499 200 0 ... 2003-10-21T12:39:53 0 0 0 0 E 7728 302 0 2003-10-21T12:39:53 0 1 0 1 E 14049 302 0 2003-10-21T12:39:53 0 4 0 4 E 84388 200 2 2003-10-21T12:39:54 0 1 0 1 E 18137 200 0 2003-10-21T12:39:57 0 1 0 1 E 11716 200 1 urls 2003-10-21T12:39:58 0 1 0 1 E 18322 302 0 ... 2003-10-21T12:39:59 0 3 0 3 E 15407 200 0 ... 2003-10-21T12:40:03 0 1 0 1 E 26706 200 1 2003-10-21T12:40:04 0 NA NA 0 I NA NA 138 urls 2003-10-21T12:40:05 0 NA NA 0 I NA NA 137 ... 2003-10-21T12:40:05 0 1 0 1 E 8084 200 2 ... 2003-10-21T12:40:05 0 2 0 2 E 14568 302 2 ... 2003-10-21T12:40:06 0 NA NA 0 I NA NA 134 ... 2003-10-21T12:40:07 0 NA NA 0 I NA NA 133 ... 2003-10-21T12:40:08 0 NA NA 0 I NA NA 132 ... 2003-10-21T12:40:12 0 NA NA 0 I NA NA 131 ... 2003-10-21T12:40:14 0 NA NA 0 I NA NA 130 2003-10-21T12:40:18 0 NA NA 0 I NA NA 129 2003-10-21T12:40:32 0 NA NA 0 I NA NA 126 2003-10-21T12:40:32 0 NA NA 0 I NA NA 127 2003-10-21T12:40:32 0 NA NA 0 I NA NA 128 2003-10-21T12:40:34 0 1 0 1 E 339 302 0 2003-10-21T12:40:37 0 NA NA 0 I NA NA 124 2003-10-21T12:40:39 0 NA NA 0 I NA NA 123 2003-10-21T12:40:41 0 NA NA 0 I NA NA 122 2003-10-21T12:40:43 0 NA NA 0 I NA NA 121 2003-10-21T12:40:45 0 NA NA 0 I NA NA 119 2003-10-21T12:40:45 0 NA NA 0 I NA NA 120 ... ... ... 2003-10-21T12:55:25 0 NA NA 0 I NA NA 4 urls 2003-10-21T12:55:49 0 NA NA 0 I NA NA 3 ... 2003-10-21T12:55:52 0 NA NA 0 I NA NA 2 ... 2003-10-21T12:56:03 0 NA NA 0 I NA NA 1 ... 2003-10-21T12:56:09 0 NA NA 0 I NA NA 0 ... 2003-10-21T12:56:37 NA NA NA 0 U NA NA 0 System startup 2003-10-21T12:56:40 0 0 0 0 E 339 302 0 urls 2003-10-21T12:56:41 0 0 0 0 E 873 302 1 ... 2003-10-21T12:56:41 0 0 0 0 E 339 302 0 ... 2003-10-21T12:56:41 0 0 0 0 E 873 302 0 ... 2003-10-21T12:56:41 0 0 0 0 E 1672 500 0 ... What can I read from these? Is any of these logs descriptive enough to say what is wrong with my Zope? How to do more investigation? I've got some more Zope instances that works perfectly stable in similar configuration but not with Oracle database, maybe this is a source of these hangs? Thanks -- Jakub Wisniowski

3 2

Building Zope on Windows
by Etienne Labuschagne 22 Oct '03

22 Oct '03

After Googling around, I could not find the answer to this one: My C/C++ experience is limited to working in Borland's C++ Builder environment which hides most of the make/build intricacies from the user. As a result I do not have a clue how to create make files. As a result I do not have a clue how to build Zope on Windows. I want to play around with Zope 2.7b running on Python2.3 and cannot find binaries or instructions on building Zope against Python2.3 on Windows. I'm sure that I'll get it running on Linux, but for various reasons (out of my control) our working environment is Windows and not Linux. If the answer to this question turns out to be RTFM, at least point me in the direction of the M! Thanks Etienne

4 4