- Zope - Zope lists

RE: [Zope] Zope Eating Memory for Breakfast
by Chris McDonough 13 Apr '00

13 Apr '00

Both of you seem to be using Sybase DAv2, for which there was a known memory leak. The latest release got rid of it. Are you running the latest releases, respectively? > -----Original Message----- > From: Bill Anderson [mailto:bill@libc.org] > Sent: Wednesday, April 12, 2000 6:49 PM > To: zope(a)zope.org > Subject: Re: [Zope] Zope Eating Memory for Breakfast > > > Hung Jung Lu wrote: > > > Well, I am *not* having memory problems, but since my setup may be > useful in that regard: > > > > --- In zope(a)egroups.com, Tony McDonald <tony.mcdonald@n...> wrote: > > > >This is on Solaris 2.7 with Zope 2.1.4. I can provide > any other info you > > > >like, but I'm not sure what would be useful to know. > > > > PID USERNAME THR PRI NICE SIZE RES STATE TIME > CPU COMMAND > > > > 5866 zope 8 10 0 2262M 2034M cpu2 149:09 > 24.70% python > > > > Wow wow wow, sometimes my Zope eats up to 160 MB of RAM memory, > > and I thought that was bad. :) > > > > There's gotta be a memory leak somewhere in Zope. And we'd > > better figure out where it is. I have already seen several > > messages complaining about Zope's memory usage. > > > > ------------------------------------------------------------- > > > > OK, let us try to narrow down a bit. > > > > (1) Version: I also use Zope 2.1.4. System is Linux. > > > About 7 currently running Zopes at the moment. Ranging from 2.1.3 to > 2.1.6, with the majority being 2.1.4 > > > (2) Webserver: ZServer with multiple threads. > > ZServer, 4-6 threads, running behind Roxen (-1 on it's own) > > > (3) Products: I use SybaseDAv2 for database adapter. I also > > use a bit of Gadfly (through SQLSession), this of course is > > a temporary feature because eventually I want to get rid of > > Gadfly. > > > > (4) ZODB: I don't have anything that dynamically changes Zope's > > ZODB, that is, I don't upload files into ZODB (Do you?), I > > don't create more Zope users on the fly. In fact, I believe my > > site can run from a CD-Rom, if necessary. > > > I am using Sybase DA, PTK on four, and BannerClasses which > modifies the > Data.fs _every_ page view. > > > (5) Size of ZODB: my Data.fs is about 9 MB. > > Sizes: > from <1M to 50M at a given time. > > > > (6) Uptime pattern: the maximum time I have run Zope is less > > than a week. Usually I restart it a few times a week. > > Mang up for weeks at atime, obvious exception would be the two test > servers. > > > (7) Memory growth pattern: my Zope starts out with 7 MB in each > > of the 4 threads. It starts to climb up slowly, by the end of > > the day it reaches 18 MB per thread. After 3 days it climbs up > > to 38 MB. That's about 160 MB total. (No, I don't think the > > threads are sharing memory, because the Linux "top" command > > also tells me the percentage of memory usage.) > > The Linux 'Top' command is a tricky beast. > How much memory is _in_use_? Can't tell that with Top (without a > callculator anyway ;). > Use 'free', it will report the amount currently in use, the amount in > buffer, cache, etc. > ...and do the math for you. > > If I were to count the memory for _each_ thread, it would allegedly be > on the order of 200-300MB easy. In reality, it isn't using > anywhere near > that. The memory statistics per thread in Linux _is_ a 'shared' memory > amongst the threads (though not in the programmatic definition). > > > > (9) Database Management cache parameters: (from Zope's > control panel) > > > > Total number of objects in the database 4285 > > Total number of objects in all of the caches combined 1533 > > Target size 400 > > Target maximum time between accesses 60 > > > > Flush Cache: Full Sweep and Minimize don't help to reduce the > > memory consumption. > > Average object cache target: 5000 > Number in cache (average): 4000 > Average max time: 180 seconds. > > > Hope it helps in some way. > Bill > > -- > In flying I have learned that carelessness and overconfidence are > usually far more dangerous than deliberately accepted risks. > -- Wilbur Wright in a letter to his father, September 1900 > > _______________________________________________ > Zope maillist - Zope(a)zope.org > http://lists.zope.org/mailman/listinfo/zope > ** No cross posts or HTML encoding! ** > (Related lists - > http://lists.zope.org/mailman/listinfo/zope-announce > http://lists.zope.org/mailman/listinfo/zope-dev ) >

1 0

convert <dml-var TEXT> to bullet list
by Jorge Magalhaes 12 Apr '00

12 Apr '00

Hi: In <dtml-var description> (description type is text) how i can convert newlines characters, carriage-return characters, and new-line-carriage-return character combinations to a HTML tag for making a bullet list item. I need something like newline_to_br thanks. jorge.

1 0

corrupted dbase
by Ingo Assenmacher 12 Apr '00

12 Apr '00

Hi Everyone. This is another one from my number one hobbies: how to corrupt ZDB. Another strange thing happened: I allowed users to perform an upload into ZDB via "manage_upload" on an file object. So far, so good. Alas, it had slipped my mind one time, I did not give the "Change images and files" permission to every group. So it happened: a member belonging to a group without the permission performed an upload and the Zope security did (absolutely right) forbid this by uttering an "unauthorised". So far, so good. Sadly, the object to be uploaded had already been into ZDB (the user tried to actualise the file) and suddenly, the Document was no longer of a file type, but something else (a custom folder class). My efforts to delete this item resulted in: Error Type: SystemError Error Value: Failed to import class ImplicitAcquirerWrapper from module Acquisition Traceback (innermost last): File /amnt/home/assen/Zope-2.1.1-linux2-x86/lib/python/ZPublisher/Publish.py, line 214, in publish_module File /amnt/home/assen/Zope-2.1.1-linux2-x86/lib/python/ZPublisher/Publish.py, line 179, in publish File /amnt/home/assen/Zope-2.1.1-linux2-x86/lib/python/Zope/__init__.py, line 202, in zpublisher_exception_hook (Object: ElementWithAttributes) File /amnt/home/assen/Zope-2.1.1-linux2-x86/lib/python/ZPublisher/Publish.py, line 165, in publish File /amnt/home/assen/Zope-2.1.1-linux2-x86/lib/python/ZPublisher/mapply.py, line 160, in mapply (Object: manage_delObjects) File /amnt/home/assen/Zope-2.1.1-linux2-x86/lib/python/ZPublisher/Publish.py, line 102, in call_object (Object: manage_delObjects) File /usr/lib/zope/lib/python/OFS/ObjectManager.py, line 401, in manage_delObjects (Object: ElementWithAttributes) File /usr/lib/zope/lib/python/OFS/ObjectManager.py, line 273, in _delObject (Object: ElementWithAttributes) File /amnt/home/assen/Zope-2.1.1-linux2-x86/lib/python/ZODB/Connection.py, line 396, in setstate SystemError: (see above) hmmm... All I want to do is to erase these corrupted objects, but I can not do this within the management interface. So, how can I do this? regard, ingo.

1 0

The zope howto/etc search interface
by jiva＠devware.com 12 Apr '00

12 Apr '00

Using the search function on www.zope.org is often frustrating. I *know* the information is out there, I *remember* seeing this particular howto, yet, I type in words I think should find it, and I don't seem to have much luck. Is the zope search interface in use at zope.org open source? Is it something maybe I could look at and offer to help "fix" it so it'll work better for me and others? -- We're only in it for the volume. -- Black Sabbath

1 0

Issue Tracker
by Paolo Marini 12 Apr '00

12 Apr '00

Hi all, I would like to knwo where is the code for the PTK Issue Tracker Thank you Paolo Marini

1 0

another database option: Kdb
by Gijs Reulen 12 Apr '00

12 Apr '00

Hi there See link: www.Kx.com I am a newbie with Zope; just went through some docs and keeping an eye on this list. Cool tool ! I like to point out to a database I came across a while ago: Kdb. It is a very small application, written in the language k. The total download is only 400 kb ! The database is build to be very fast. >From what I understand it stores data in fields instead of records as 'old' databases do. It also tries to keep everything in ram and is very efficient using it. The company behind it pushes the product for analysing very large datasets: telephone-companies, minute to minute share-prices and such. From what I read and heard the speed is really incredible !! The commercial version starts at about USD 5000, but their site has a free testversion available which can hold easily a few million records ... That not all: they believe accessing the data is very important (ok, ok) and offer interfacing with java, Visual Basic, odbc, etc but most interesting also something like "http://localhost:2080/.xml?select sum amount by stock > from trade". Have a look at the company: www.kx.com Gijs Reulen

1 0

SiteRootPATH + apache + proxy + SSL + zserver
by Juan Carlos Coruña 12 Apr '00

12 Apr '00

Hi all, After looking through the mailing list I don't found any solution for my problem. Here is the problem: I have two domains each in a different location with the same Data.fs (I replicate it every night). The domains must work with SSL in the future, so I use the proxypass method with apache. To rewrite the in line links of zope I use SiteAccess and if I set the property BASE and PATH for one domain it doesn't work for the other domain. Then I tested some configurations in httpd.conf for setting the variables SiteRootBASE and SiteRootPATH idenpendently for every server without success. Anyone has solved this problem? Thanks.

2 1

Re: [Zope] Using external methods
by Hung Jung Lu 12 Apr '00

12 Apr '00

--- In zope(a)egroups.com, "Daniel G. Rusch" <drusch@g...> wrote: > How does one install third party python products such as PIL or >ReportLab so that Zope's python interpreter can find it in it's path. ... >Should I install them in the Extensions directory or where? How does one >set the Zope python path? Or is the evaluator stuck half way up. (1) If you have a tree of packaged modules, you might consider installing them under the (YourZopeRoot)/lib/python folder, remember to drop in a __init__.py in the root of your package. lib/python is the place where you want to install your python modules. (2) You can also add the python paths dynamically inside your z2.py file, if the modules are located elsewhere. The z2.py file is located at the root of your Zope installation. import sys sys.path.append('your path here') regards, Hung Jung ______________________________________________________ Get Your Private, Free Email at http://www.hotmail.com

3 2

n-tier architecture
by Greg Lappen 12 Apr '00

12 Apr '00

Hi all, I am evaluating Zope as an alternative to J2EE (Enterprise Java Beans, Java Server Pages, Servlets, etc.) In a J2EE application, the JSP and servlet are the presentation layer, the EJB's are the business logic layer, and the database is the data layer. How does this map to Zope? It looks like you put your business logic in DTML methods, but this seems like the business logic would get scattered throughout the presentation layer. Any help would be appreciated. Thanks! Greg

1 0

Re: [Zope] n-tier architecture
by Tony Rossignol 12 Apr '00

12 Apr '00

Greg Lappen wrote: > > Hi all, I am evaluating Zope as an alternative to J2EE (Enterprise Java > Beans, Java Server Pages, Servlets, etc.) In a J2EE application, the > JSP and servlet are the presentation layer, the EJB's are the business > logic layer, and the database is the data layer. How does this map to > Zope? The database remains the data layer. Business logic can be designed into Products and ZClasses. And the presentation layer is DTML. From a presentation layer centric environment this means your Designers - presentation layer workers - can produce much more efficiently than in JSP or Servlets the syntax much easier to use. Your Developers - business logic workers - can control access, deligate responsibility and code to one common interface. And you database people can continue to develope in the same space as before. > It looks like you put your business logic in DTML methods, but this > seems like the business logic would get scattered throughout the > presentation layer. If you try to put business logic in DTML it will get scattered all over the place. Look to ZClasses for simple business objects and a full blown Zope Product for complex objects. The product will mean work in Python, but from my experience it's a faily easy language to use. Good luck in your evaluation and keep us posted. -- ------------------------------- tonyr(a)ep.newtimes.com Director of Web Technology New Times, Inc. -------------------------------

1 0