[ZCM] [ZC] 1342/ 4 Comment "ZServer/FTPServer.py exceptions.MemoryError"

[Collector: Zope Bugs, Features, and Patches ...]

Issue #1342 Update (Comment) "ZServer/FTPServer.py exceptions.MemoryError"
 Status Pending, ZServer/bug low
To followup, visit:
  http://collector.zope.org/Zope/1342

==============================================================
= Comment - Entry #4 by shiao on May 20, 2004 12:02 am

I guess that 0x1000000 should say 0xF4240.
________________________________________
= Comment - Entry #3 by shiao on May 19, 2004 11:57 pm

OpenBSD will compile with the following options

-DNDEBUG -O2   -DTHREAD_STACK_SIZE=0x20000 -fPIC

I compile a new version with DTHREAD_STACK_SIZE=0x1000000

python version is
Python 2.3.3 (#1, May 19 2004, 23:31:25)
[GCC 2.95.3 20010125 (prerelease, propolice)] on openbsd3

And ulimit has the following settings.

$ ulimit -a
time(cpu-seconds)    unlimited
file(blocks)         unlimited
coredump(blocks)     unlimited
data(kbytes)         65536
stack(kbytes)        4096
lockedmem(kbytes)    78305
memory(kbytes)       233452
nofiles(descriptors) 64
processes            64

runzope and trying to ftp some files it reports the following:

500 'EPSV': command not understood.
227 Entering Passive Mode (127,0,0,1,57,24)
451 Server Error: thread.error, can't start new thread


Changing ulimit -a
$ ulimit -a
time(cpu-seconds)    unlimited
file(blocks)         unlimited
coredump(blocks)     unlimited
data(kbytes)         100000
stack(kbytes)        9128
lockedmem(kbytes)    78305
memory(kbytes)       233452
nofiles(descriptors) 128
processes            64

I am able to upload some files, but then event.log shows:

2004-05-19T23:51:26 ERROR(200) ZServer uncaptured python exception, closing channel <ZServer.medusa.ftp_server.recv_channel connected 127.0.0.1:46297 at 0x3cd67eec> (exceptions.MemoryError:out of memory [/usr/local/lib/python2.3/asyncore.py|read|69] [/usr/local/lib/python2.3/asyncore.py|handle_read_event|390] [/usr/home/shiao/prog/Zope-2.7.0/lib/python/ZServer/medusa/ftp_server.py|handle_read|937] [/usr/home/shiao/prog/Zope-2.7.0/lib/python/ZServer/FTPServer.py|write|543]

In this case, 25 were uploaded ok.

Note that python does not core dump, and ZServer runs just fine for new connections. I will try to upload one file at a time (manually) to see if it works. Maybe the dealy between files makes a differences (?)


________________________________________
= Comment - Entry #2 by camil7 on May 19, 2004 3:19 pm

Chances are this has something to do with the "too small default stack size" issue on BSD .

 Please read the Zope/doc/PLATFORMS/BSD.txt which
should be shipped with the Zope documentation 
(at least in the sources).

________________________________________
= Request - Entry #1 by shiao on May 18, 2004 11:47 pm

OS: OpenBSD 3.5
Zope: 2.7.0
Python 2.3.3 (#1, Mar 23 2004, 16:24:51)
[GCC 2.95.3 20010125 (prerelease, propolice)] on openbsd3

The following exception occurs when uploading files (.jpg) via ftp passive to a newly created instance. This does not occur using the same test on a Gentoo 2.6.5/Python 2.3.3/Zope 2.7.0. I believe it should be something about python. Is there a way to confirm this?

2004-05-18T23:35:50 ERROR(200) ZServer uncaptured python exception, closing channel <ZServer.medusa.ftp_server.recv_channel connected at 0x3cefc1ac> (exceptions.MemoryError:out of memory [/usr/local/lib/python2.3/asyncore.py|read|69] [/usr/local/lib/python2.3/asyncore.py|handle_read_event|390] [/usr/home/shiao/prog/Zope-2.7.0/lib/python/ZServer/medusa/ftp_server.py|handle_read|937] [/usr/home/shiao/prog/Zope-2.7.0/lib/python/ZServer/FTPServer.py|write|543])

==============================================================