January 2005 - Zope - Zope lists

Re: [Zope] IOError: [Errno 13] Permission denied (Zope 2.7.3)
by Magnus Lawrie 10 Jan '05

10 Jan '05

Andreas Jung wrote: > > > --On Montag, 10. Januar 2005 5:50 Uhr +0000 Magnus Lawrie > <m.lawrie(a)gmx.net> wrote: > >> Andreas Jung wrote: >> >>> >>> >>> --On Sonntag, 9. Januar 2005 23:52 Uhr +0000 Magnus Lawrie >>> <m.lawrie(a)gmx.net> wrote: >>> >>>> I installed python 2.3.4 and then zope 2.7.3 from source and ran >>>> mkzopeinstance.py, but am experiencing a problem with privileges. I >>>> gather that I have to change some, but I do not know exactly how to do >>>> that. I have looked at >>>> >>>> http://www.plope.com/Books/2_7Edition/InstallingZope.stx >>>> >>>> And this post: >>>> >>>> http://www.gossamer-threads.com/lists/zope/users/177930 >>>> >>>> ...but am no clearer. >>>> >>>> Runzope results in: >>>> >>>> IOError: [Errno 13] Permission denied: >>>> '/home/mdl/zope-instance/var/Data.fs.lock ' >>>> >>> >>> This usually happens if you install or run Zope as root which is not >>> recommended (and documented >>> in various places). >>> >>> -aj >>> >>> > > >> Yes, I did read that. I downloaded tarballs and worked out of my home >> directory but (being a novice only) didn't find a better way than: >> sudo make install > > ^^^^^^^^^^^^^^^^^^ > > There is no reason to run "make install" as root if you compile and > install using the same account > that will be used to run Zope! > >> make install wouldn't complete. > > > Why not? Please provide a traceback or error messages. > > Andreas > > > > I don't have a record of the original error, but ran the make install command once again. The last three lines: copying version.txt -> /opt/Zope-2.7/lib/python/. error: /opt/Zope-2.7/lib/python/./version.txt: Permission denied make: *** [install] Error 1

2 2

Re: [Zope] IOError: [Errno 13] Permission denied (Zope 2.7.3)
by Magnus Lawrie 10 Jan '05

10 Jan '05

Andreas Jung wrote: > > > --On Montag, 10. Januar 2005 5:50 Uhr +0000 Magnus Lawrie > <m.lawrie(a)gmx.net> wrote: > >> Andreas Jung wrote: >> >>> >>> >>> --On Sonntag, 9. Januar 2005 23:52 Uhr +0000 Magnus Lawrie >>> <m.lawrie(a)gmx.net> wrote: >>> >>>> I installed python 2.3.4 and then zope 2.7.3 from source and ran >>>> mkzopeinstance.py, but am experiencing a problem with privileges. I >>>> gather that I have to change some, but I do not know exactly how to do >>>> that. I have looked at >>>> >>>> http://www.plope.com/Books/2_7Edition/InstallingZope.stx >>>> >>>> And this post: >>>> >>>> http://www.gossamer-threads.com/lists/zope/users/177930 >>>> >>>> ...but am no clearer. >>>> >>>> Runzope results in: >>>> >>>> IOError: [Errno 13] Permission denied: >>>> '/home/mdl/zope-instance/var/Data.fs.lock ' >>>> >>> >>> This usually happens if you install or run Zope as root which is not >>> recommended (and documented >>> in various places). >>> >>> -aj >>> >>> > > >> Yes, I did read that. I downloaded tarballs and worked out of my home >> directory but (being a novice only) didn't find a better way than: >> sudo make install > > ^^^^^^^^^^^^^^^^^^ > > There is no reason to run "make install" as root if you compile and > install using the same account > that will be used to run Zope! > >> make install wouldn't complete. > > > Why not? Please provide a traceback or error messages. > > Andreas > > "/usr/local/bin/python" "/home/mdl/Zope-2.7.3-0/setup.py" \ build --build-base="/home/mdl/Zope-2.7.3-0/build-base/python-2.3" --build-lib="/home/mdl/Zope-2.7.3-0/build-base/python-2.3/build-lib" --build-scripts="/home/mdl/Zope-2.7.3-0/build-base/python-2.3/build-scripts" --build-temp="/home/mdl/Zope-2.7.3-0/build-base/python-2.3/build-temp" running build running build_py running build_ext running build running build_py running build running build_scripts echo -n "Zope 2.7.3-0" >\ "/home/mdl/Zope-2.7.3-0/lib/python/version.txt" "/usr/local/bin/python" "/home/mdl/Zope-2.7.3-0/setup.py" install \ --home="/opt/Zope-2.7" --build-base="/home/mdl/Zope-2.7.3-0/build-base/python-2.3" --build-lib="/home/mdl/Zope-2.7.3-0/build-base/python-2.3/build-lib" --build-scripts="/home/mdl/Zope-2.7.3-0/build-base/python-2.3/build-scripts" --build-temp="/home/mdl/Zope-2.7.3-0/build-base/python-2.3/build-temp" running install running build running build_py running build_ext running install_lib running install_data copying version.txt -> /opt/Zope-2.7/lib/python/. error: /opt/Zope-2.7/lib/python/./version.txt: Permission denied make: *** [install] Error 1

1 0

IOError: [Errno 13] Permission denied (Zope 2.7.3)
by Magnus Lawrie 10 Jan '05

10 Jan '05

I installed python 2.3.4 and then zope 2.7.3 from source and ran mkzopeinstance.py, but am experiencing a problem with privileges. I gather that I have to change some, but I do not know exactly how to do that. I have looked at http://www.plope.com/Books/2_7Edition/InstallingZope.stx And this post: http://www.gossamer-threads.com/lists/zope/users/177930 ...but am no clearer. Runzope results in: IOError: [Errno 13] Permission denied: '/home/mdl/zope-instance/var/Data.fs.lock ' Also, is there any special procedure for removing an instance? thanks again,

3 3

zope 2.7 startup message
by Magnus Lawrie 09 Jan '05

09 Jan '05

I have removed Zope 2.6, then installed 2.7 on Ubuntu mdl@ubuntu:/usr/local/lib $ /etc/init.d/zope2.7 start Zope starting all instances.... '*' is an old/purged instance, not started What does this mean? thanks for your attention.

2 1

_finish and _abort not called in a TM subclass
by Marco Bizzarri 09 Jan '05

09 Jan '05

Hi all. I'm trying to figure out the proper way to use the Shared.DC.ZRDB.TM.TM mixin class. According to the documentation, I should derive from that class, redefine my _abort and _finish methods, and then call the _register method whenever it is needed. I've created the following sample product, named CacheProduct. It has two methods which can be called from the web, registerFromWeb and resetMe. The first calls the _register, the second puts the self._registered variable to 0. I've also added some prints, in order to check the results. If all goes well, I should see something like: before: 0 after: 1 _finish However, if I use ab to do a check, like ab -c 10 -n 1000 http://server:8080/CacheProduct/registerFromWeb I can see: _before: 1 _after: 1 which should never happen. Also, I don't see the required calls to _finish. After some request, the _finish reappers, only to disappear again. Has anyone any suggestion on this topic? Regards Marco

2 2

Report Writer
by mettwoch＠pt.lu 08 Jan '05

08 Jan '05

Hi, I'm looking for building blocks to use for our "shop"-management solution. Does anybody know a solution/product to print out from Zope structured documents like invoices, open-balances, cash-flow reports ... .In more general the tool I'm looking for should be able to build documents (even multipage) with report-headers and -footers and page-headers and -footers, running sums, sorts ... . These documents should be send immediately to the printer (not displayed in the browser and waiting for the user to hit "print"). The source of data is a MySQL database. By the way, I use MailManager to handle our mail traffic - a cool product. Thx -- mettwoch(a)pt.lu

3 2

Passive FTP Trouble
by hpinson＠indepthl.com 07 Jan '05

07 Jan '05

Hello. We are having trouble with FTP behind a NAT DSL gateway. When we FTP in to port 8021, using Dreamweaver MX, we connect, but do not get a directory listing-- only the current folder is listed. No subfolders are listed so navigation is not possible. Any idea why this is, and how to solve it? Zope 2.73 on Fedora Core 2. Harlow Pinson Indepth Learning Email: hpinson(a)indepthl.com Web: http://www.indepthl.com Voice: 505-994-2135 FAX: 208-475-7678

2 1

Security questions
by Garito 07 Jan '05

07 Jan '05

Hi I have some kind of problems to understand how Zope's security rules If I have these distribution: root Blogs Blog1 Blog2 Blog3 where Blogs: Folder Blog1, 2, 3: Coreblog product How can I configure the security to have 3 users (User1, User2, User3) who can log on ZMI to manage their weblogs? I suppose (but don't work properly for me) I need to create a user folder on Blogs folder and create 3 users on it, isn't it? Thanks!

2 1

RE: [Zope] Zope 2.7.3 Memory Leaks
by Andy Yates 07 Jan '05

07 Jan '05

> > The fact remains that if given enough time Zope will use so much memory > > that it crashes the server. I've reproduced this on at least 3 Linux servers > > with a clean install of Zope. The pattern SEEMS to be the more data I > > put in a session object the faster the server dies. This can not be > > normal behavior. I'm used to servers running for months. I have to > > restart Zope every 3 days at least. I need to at least have a long > > weekend away form this thing! ;-) > > > > Can anybody please verify my results. I've given a very simple test > > case. If I'm only one in the world that can cause this to happen then > > fine. At least that narrows my search to something internal to our > > system. > > I think people are trying to help, and you need to follow up more. Oh I know and I'm grateful. Please don't misunderstand. My frustration is with the situation not with the members of the list. I have a high respect for the Zope community and especially those that take to time to help with people's bizarro problems. > For example, I didn't see a reply to Tres's questions in this thread, > and I didn't see what looked like a particularly relevant reply to > Dieter's observation that the test setup appears to provoke an > unbounded number of sessions each with a 45-minute timeout (although > Dieter appeared to miss this part of the message he was replying to: > > The session timeout does not seem to affect the memory use. We even > tried setting the session timeout to 1 minute. > > your reply to him didn't have any indication of how many > requests/sessions were getting created; and you didn't respond to his > point that he limits max sessions to 5000 -- Tres also asked about max > # of sessions). > ... > The upper bound on the sessions is not relevant in my opinion. We have set it to unlimited because no matter what we have set it to in the past we always seem to spike up to it when nobody is around to delete the session objects by hand. This happens because of something very specific to the wi-fi hotspot market that I'd rather not go into. In most cases we avoid these spikes but it can happen so we do not set a limit. 99.9% of the time we have 500-2000 objects in the transient object container. Dieter is right. My test could provoke an unbound number of sessions but it doesn't because of the way the test is run. I'm not trying to simulate one user making 1000 requests. I'm trying to simulate 1000 users making one request which should produce 1000 sessions. These sessions are allowed to timeout and then we create 1000 more. If this cycle is repeated enough times all memory is consumed and the server crashes. This happens even if there are hours between cycles. The memory use never goes down it just grows even though the number of sessions never goes over 1000. > How many simultaneous sessions are we talking about? A few hundred > simultaneous users could chew up RAM pretty fast. What is your "max > number of sessions" value? > > Tres. Sorry, Tres's. Let me explain. The max sessions or the amount of data in each session should not matter. The server should reach some steady state value of memory usage. This is because you always have new users coming to the site which creates new session objects, but on the other end you have users that have gone away and so their sessions expire. When one restarts the server I would expect the steady state to happen within 3 or 4 times the session timeout value. My problem is that this steady state never seems to happen. Memory use just goes up and up. I have found something today! We store some images for our site in a MySQL database. I noticed today that these images (some could be large) are copied to the session object. This was probably done to reduce queries to the database. There are so many caches along the way ( browser, Zope, zsql...) that this is probably not needed. I turned this feature off. At least this should push the horizon off a bit. Time will tell. > > Please don't take offence I'm sure the BTree code is really cool. > > Oh, no offense at all! C code usually leaks like a sieve when it's > new <wink>. I was just trying to steer you away from the BTree code > in this case, because it's not new, has benefited from a lot of work > to plug leaks, and just isn't a high-probability suspect anymore. > BTW, you *do* see BTree building blocks from the debug control panel; > they're in the lines like: > > BTrees.OOBTree.OOBTree 2019 11997 +9978 > BTrees.OOBTree.OOBucket 1297 5512 +4215 > > > I'm just grasping at straws. When this problem started I was told the > > problem must be in MY code. So I removed ALL my code and made a very > > simple test case that reproduces the problem. Then I was told well you > > just don't understand how memory REALLY works. > > I didn't see anyone say that in this thread. Maybe I missed it. Perhaps stated too strong that's just my impression. I was referring to the long posts last month about how Zope, python, and Linux manage memory. That's all voodoo to me. I just don't understand how this simple test can cause so much memory to be used. > > At this point I don't really care how memory really works. I just want to be > > able to put data in session objects without my server crashing. > > Sure. > > > Run my test case and see what happens. I double dog dare you! ;-) > > Sorry, but I don't have time to dig into this at all. My replies have > just regurgitated info I knew off the top of my head. That doesn't > mean I think your problem is trivial, it just means I can't volunteer > substantive help. Can't blame you there. I don't have time for this either. I'm going to restart my Zope server just for good measure and go to the gym. Y'all have to great weekend! Andy

1 0

RE: [Zope] Zope 2.7.3 Memory Leaks
by Andy Yates 07 Jan '05

07 Jan '05

> > ... > > For example if I have ab make X requests, X new sessions are created and > > memory use goes up by 100MB. I also see about X objects in the > > transient object container. Now I wait for the sessions to expire based > > on the "Data object timeout value". Then I make a few calls to tickle > > the Transient system's garbage collection. The objects in the toc goes > > down but memory use does not. Some have posted that python does not > > release memory it just reuses it. Well, when I make X more requests the > > memory is not reused. Now it is using 200MB. > > I know as much about the gory details of Python's memory-management as > anyone on Earth, so you can believe this: if anyone gives you a > catchy one-line summary, don't believe them. Let's not go into the gory details. Another discussion of the complexities of memory management will not be productive. The fact remains that if given enough time Zope will use so much memory that it crashes the server. I've reproduced this on at least 3 Linux servers with a clean install of Zope. The pattern SEEMS to be the more data I put in a session object the faster the server dies. This can not be normal behavior. I'm used to servers running for months. I have to restart Zope every 3 days at least. I need to at least have a long weekend away form this thing! ;-) Can anybody please verify my results. I've given a very simple test case. If I'm only one in the world that can cause this to happen then fine. At least that narrows my search to something internal to our system. > No. The BTree code is really part of ZODB, and has been there (as far > as I know) forever; Jeremy Hylton and I did a lot concentrated work to > squash memory leaks in ZODB (including its BTree code) a couple years > ago. The BTree code has been very stable (== has been changed very > little) since then. Please don't take offence I'm sure the BTree code is really cool. I'm just grasping at straws. When this problem started I was told the problem must be in MY code. So I removed ALL my code and made a very simple test case that reproduces the problem. Then I was told well you just don't understand how memory REALLY works. At this point I don't really care how memory really works. I just want to be able to put data in session objects without my server crashing. Run my test case and see what happens. I double dog dare you! ;-) Andy

2 1