- Zope-Dev - Zope lists

Very serious problem with Zope 2.4.x !!
by Stefano Noferi 14 Dec '01

14 Dec '01

Hi, I've a very serious problem with Zope 2.4.x and Python 2.1/2.1.1/2.2b2 running on linux. Zope auto restart when I call a simple python script with this contents: ------------------start-------------- province = [('AG','Agrigento'),('AL','Alessandria'),('AN','Ancona'),('AO','Aosta'),('AR ','Arezzo'),('AP','Ascoli Piceno'),('AT','Asti'),('AV','Avellino'),('BA','Bari'),('BL','Belluno'),('BN ','Benevento'),('BG','Bergamo'),('BI','Biella'),('BO','Bologna'),('BZ','Bolz ano'),('BS','Brescia'),('BR','Brindisi'),('CA','Cagliari'),('CL','Caltanisse tta'),('CB','Campobasso'),('CE','Caserta'),('CT','Catania'),('CZ','Catanzaro '),('CH','Chieti'),('CO','Como'),('CS','Cosenza'),('CR','Cremona'),('KR','Cr otone'),('CN','Cuneo'),('EN','Enna'),('FE','Ferrara'),('FI','Firenze'),('FG' ,'Foggia'),('FO','Forlì'),('FR','Frosinone'),('GE','Genova'),('GO','Gorizia' ),('GR','Grosseto'),('IM','Imperia'),('IS','Isernia'),('AQ',"L'Aquila"),('SP ','La Spezia'),('LT','Latina'),('LE','Lecce'),('LC','Lecco'),('LI','Livorno'),('LO ','Lodi'),('LU','Lucca'),('MC','Macerata'),('MN','Mantova'),('MS','Massa Carrara'),('MT','Matera'),('ME','Messina'),('MI','Milano'),('MO','Modena'),( 'NA','Napoli'),('NO','Novara'),('NU','Nuoro'),('OR','Oristano'),('PD','Padov a'),('PA','Palermo'),('PR','Parma'),('PV','Pavia'),('PG','Perugia'),('PS','P esaro e Urbino'),('PE','Pescara'),('PC','Piacenza'),('PI','Pisa'),('PT','Pistoia'),( 'PN','Pordenone'),('PZ','Potenza'),('PO','Prato'),('RG','Ragusa'),('RA','Rav enna'),('RC','Reggio Calabria'),('RE','Reggio Emilia'),('RI','Rieti'),('RN','Rimini'),('RM','Roma'),('RO','Rovigo'),('SA', 'Salerno'),('SS','Sassari'),('SV','Savona'),('SI','Siena'),('SR','Siracusa') ,('SO','Sondrio'),('TA','Taranto'),('TE','Teramo'),('TR','Terni'),('TO','Tor ino'),('TP','Trapani'),('TN','Trento'),('TV','Treviso'),('TS','Trieste'),('U D','Udine'),('VA','Varese'),('VE','Venezia'),('VB','Verbania'),('VC','Vercel li'),('VR','Verona'),('VV','Vibo Valentia'),('VI','Vicenza'),('VT','Viterbo'),('EE','Stato Estero')] return province ------------------end--------------- Zope restart with a DTML Method version of this script too. It's a very serious problem because Zope restart with a segmentation fault. I've tested this "bug" in Zope 2.4.1, 2.4.2, 2.4.3, 2.5.x... the same result. ; ( I've posted this bug in Zope Collector ( http://collector.zope.org/Zope/76 ) but I've got no reply.. I suppose it's a problem of Restricted Python machinery that PythonScript and DTML share. Compiling python with "--without-pymalloc" option Zope autorestart itself with a minor frequency.. but it restart.. ; (( IMPORTANT: I tested it with a NEW Zope instance with simply only one PythonScript in the root folder with the content I specified.. It restart!! Solutions? ---------------------------------------------------------- Stefano Noferi n o z e S.r.l. Soluzioni Open-Source Via Caduti del Lavoro, 32 56122 Pisa (PI) - Italy Tel: +39 (0)50 533320 Fax: +39 (0)50 526604 Email: stefano(a)noze.it Web: http://www.noze.it -= "Whatever you like it to be, it will be" =- ----------------------------------------------------------

3 2

zope.org wiki tinkering
by Ken Manheimer 13 Dec '01

13 Dec '01

I'm going to be tinkering with the wikis on zope.org, to try installing my adaptation (and extension) of simon michael's wiki page change notifications to WikiForNow. I've exercised the changes as best i could on a separate site, and don't expect any disruptions, but the unexpected sometimes happens.-) I'll followup to zope-web shortly with details about the changes and help i'd like banging on them, once they're ready for trials, and then to zope-announce describing the new features once they're ready for wide release. I expect all this to be happening today, maybe stretching into tomorrow depending on the, well, the unexpected... -- Ken klm(a)zope.com

1 0

Merhabalar;
by Can Canbilek 13 Dec '01

13 Dec '01

Öncelikle rahatsýz ediyorsak özür dileriz ama bu maili okursanýz sanýrým bize teþekkür edeceksiniz. Sizlere, hiçbir masraf yapmadan yalnýzca internete girerek para kazanacaðýnýzý iddia ediyoruz. Hiçbir yalan dolan, hile olmadan.... Üstelik kredi kartý numaranýzý bile vermeniz gerekmiyor. Ufak bir formu dolduruyorsunuz, dünyaca ünlü bir þirket olan ve dünyanýn heryerine ( Türkiye dahil olmak üzere ) para yollayan bu þirketin küçük bir programýný download ediyorsunuz. Daha sonra her internete giriþinizde bu programý açýyorsunuz ve program nete ne kadar girdiðinizi hesaplýyor. Nete girdiðiniz her saat baþý 50 cent alýyorsunuz ve bunu karþýlýðýnda ekranýnýzýn küçük bi bölümünde reklamlar görünüyor... Ayda yalnýzca 60 saat internete girerek 30$ kazanýyorsunuz tabii daha fazla kazanmak isterseniz arkadaþlarýnýzý üye ediyorsunuz. Ýster saadet zinciri, isterseniz zeka kullanýmý deyin, bence bundan daha iyi bir yöntem yok.... Ayrýntýlý bilgi gelen çeklerimizin resimleri ve olasý sorularýnýzýn cevaplarý için aþagýdaki sitelerden herhangi birine giriniz(hepsi aynýdýr): http://www25.brinkster.com/firsatlar/index.htm http://www25.brinkster.com/hizmetlerimiz/index.htm http://www25.brinkster.com/spediainc/index.htm http://www25.brinkster.com/sendekazan/index.htm Saygýlarýmla... !!!!!!!SORULARINIZ ÝÇÝN LUTFEN cancanbilek2(a)hotmail.com ADRESÝNE MAÝL ATINIZ, BU MAÝLE REPLY YAPMAYINIZ!!!! ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- BU MAILI YANLISLIKLA ALDIGINIZA INANIYORSANIZ, YADA BIRDAHA BIZDEN MAIL ALMAK ISTEMIYORSANIZ http://www21.brinkster.com/dogangoko/index.htm ADRESÝNE GÝRÝN VE SAYFADAKÝ MAÝLLÝSTÝMÝZDEN ÇIKMAK ÝÇÝN BURAYA EMAÝLÝNIZÝ YAZINIZ BOLUMUNE EMAÝLÝNIZI YAZINIZ... ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- EGER BU MAILI 2CÝ KEZ ALIYORSANIZ LÜTFEN DÝKKATE ALMAYINIZ.... ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

4 3

CatalogAware Products and PropertyManager
by Dirk Datzert 13 Dec '01

13 Dec '01

Hi, has anybody written a some hotfix-like product which makes the PropertyManager more CatalogAware ? I knew now that adding, changing, deleting properties of a CatalogAware object will not reindex the object, but I want to say that this would be a central point of interest of me. If there isn't a hotfix-like product out there I probably can write one. Regards, Dirk Datzert Rasselstein Hoesch GmbH Informatik / Anwendungsentwicklung D-56626 Andernach Koblenzer Strasse 141 http://www.rasselstein-hoesch.de Tel.: +49 (0) 2631 81-4595 Fax.: +49 (0) 2631 81-15-4595 mailto:Dirk.Datzert@rasselstein-hoesch.de

2 2

CatalogAware question
by Dirk Datzert 13 Dec '01

13 Dec '01

Hi, I want to make ZNavigator CatalogAware and thought that I only had to put CatalogAware as the first class-parent like this: def ZNavigator ( CatalogAware , ... ): ... def NavItem ( CatalogAware , ...): ... Am I right or wrong ? I want to catalog every property into ZNavigator/NavItem which a index exists in my ZCatalog named Catalog in the root-folder. Do I need to programm a special code into a Class which should CatalogAware ? Regards, Dirk Datzert Rasselstein Hoesch GmbH Informatik / Anwendungsentwicklung D-56626 Andernach Koblenzer Strasse 141 http://www.rasselstein-hoesch.de Tel.: +49 (0) 2631 81-4595 Fax.: +49 (0) 2631 81-15-4595 mailto:Dirk.Datzert@rasselstein-hoesch.de

1 0

Re: [Zope-dev] recipe for trapping SIGSEGV and SIGILL signals on solaris
by Joseph Wayne Norton 13 Dec '01

13 Dec '01

Matt - Ok, I installed everything and the system is running fine (or no worse). However, we still faced one restart so far. I have included the debug information below. This looks similiar to the problem report on sourceforge: http://sourceforge.net/tracker/?func=detail&atid=105470&aid=471942&group_id… I posted a comment to see if they have any updates. One question ... does anyone every malloc a plain ClassExtension object? It seems that every CE-based object has their own struct typedef. If so, then I think yesterday's patch problaby won't do any harm but won't help either. The current running process is being monitored by truss so I will be able to get at least one more core dump (if we get one). I won't be able to get any more information until tomorrow. Any other ideas? Thanks for your help. - joe . (gdb) info threads 17 Thread 10 0xef5b9810 in _lwp_sema_wait () 16 Thread 9 0xef647cac in _swtch () 15 Thread 8 0xef5b9810 in _lwp_sema_wait () 14 Thread 7 (LWP 5) 0xcaeb50 in ?? () 13 Thread 6 0xef647cac in _swtch () 12 Thread 5 0xef5b9810 in _lwp_sema_wait () 11 Thread 4 0xef647cac in _swtch () 10 Thread 3 0xef647cac in _swtch () 9 Thread 2 (LWP 2) 0xef5b9958 in _signotifywait () 8 Thread 1 (LWP 6) 0xef5b7488 in _poll () 7 LWP 8 0xef5b6a24 in door_restart () 6 LWP 6 0xef5b7488 in _poll () 5 LWP 5 0xcaeb50 in ?? () 4 LWP 4 0xef5b9810 in _lwp_sema_wait () 3 LWP 3 0xef5b9810 in _lwp_sema_wait () 2 LWP 2 0xef5b9958 in _signotifywait () * 1 LWP 1 0xef5b9810 in _lwp_sema_wait () (gdb) thread 14 [Switching to Thread 7 (LWP 5)] #0 0xcaeb50 in ?? () (gdb) where #0 0xcaeb50 in ?? () #1 0x516bc in collect (young=0x13dec8, old=0x13ded4) at ./Modules/gcmodule.c:379 #2 0x51984 in collect_generations () at ./Modules/gcmodule.c:484 #3 0x519fc in _PyGC_Insert (op=0xecf7d4) at ./Modules/gcmodule.c:507 #4 0x664ec in PyMethod_New (func=0x3f796c, self=0x11c0d44, class=0x3c7e5c) at Objects/classobject.c:1834 #5 0x63850 in instance_getattr2 (inst=0x11c0d44, name=0x3d5378) at Objects/classobject.c:642 #6 0x63750 in instance_getattr1 (inst=0x11c0d44, name=0x3d5378) at Objects/classobject.c:608 #7 0x63898 in instance_getattr (inst=0x11c0d44, name=0x3d5378) at Objects/classobject.c:656 #8 0x78330 in PyObject_GetAttr (v=0x11c0d44, name=0x3d5378) at Objects/object.c:1052 #9 0x895ec in builtin_hasattr (self=0x0, args=0x12ed944) at Python/bltinmodule.c:886 #10 0x35a44 in call_cfunction (func=0x1609b0, arg=0x12ed944, kw=0x0) at Python/ceval.c:2854 #11 0x33c5c in eval_code2 (co=0x3cbf80, globals=0x1, locals=0x0, args=0x2, argcount=0, kws=0x0, kwcount=0, defs=0x0, defcount=0, closure=0x0) at Python/ceval.c:1948 and so on ....

1 0

Re: [Zope-dev] RAMCacheManager and gzip
by Martijn Jacobs 12 Dec '01

12 Dec '01

> There is zlib support in Python, and it is used in Medusa already. ZServer > does not call it, but the compression stuff is there. > > There is one good reason not to use zlib though, Micro$oft Internet > Distorter does not support content-encoding: gzip and for content-encoding: > compress it expects data to be compressed using the Unix compress tool... (I > think someone reported this already... oh well) Hmm, how does mod_gzip compress it then? In every request I get from IE includes the "accept-encoding: gzip" string, and apache is sending it gzip-compressed back. Do you mean that the mod_gzip is compressing it different then zlib? mart(ijn)

3 3

Re: [Zope-dev] recipe for trapping SIGSEGV and SIGILL signals on solaris
by Joseph Wayne Norton 12 Dec '01

12 Dec '01

At Tue, 11 Dec 2001 10:42:46 -0500, Matthew T. Kromer wrote: > > > >#0 0xef5b9810 in _lwp_sema_wait () > >(gdb) info threads > > 19 Thread 10 0xef5b9810 in _lwp_sema_wait () > > 18 Thread 9 0xef5b9810 in _lwp_sema_wait () > > 17 Thread 8 0xef5b9810 in _lwp_sema_wait () > > 16 Thread 7 (LWP 8) subtract_refs (containers=0x13dec8) > > at ./Modules/gcmodule.c:166 > > > > Aha! See? > Matthew - I performed the operations that you recommended and here are the results (see below). The problem seems to be with the value of the tp_traverse field. I am not aware of any "T" type python object. I'm wondering if this is an extension class type (just a guess). I searched through all of the *.c files in zope, etc. but I as not able to find any type of name "T". I also ran across a bug posting at sourceforge ... http://sourceforge.net/tracker/?func=detail&atid=105470&aid=471942&group_id… This bug report looks very similiar. - j #0 0xef5b9810 in _lwp_sema_wait () (gdb) info threads 19 Thread 10 0xef5b9810 in _lwp_sema_wait () 18 Thread 9 0xef5b9810 in _lwp_sema_wait () 17 Thread 8 0xef5b9810 in _lwp_sema_wait () 16 Thread 7 (LWP 8) subtract_refs (containers=0x13dec8) at ./Modules/gcmodule.c:166 15 Thread 6 0xef647cac in _swtch () 14 Thread 5 0xef5b9810 in _lwp_sema_wait () 13 Thread 4 (LWP 0) 0xef647b7c in _swtch () 12 Thread 3 0xef647cac in _swtch () 11 Thread 2 (LWP 2) 0xef5b9958 in _signotifywait () 10 Thread 1 (LWP 6) 0xef5b7488 in _poll () 9 LWP 9 0xef5b6a24 in door_restart () 8 LWP 8 subtract_refs (containers=0x13dec8) at ./Modules/gcmodule.c:166 7 LWP 7 0xef5b9810 in _lwp_sema_wait () 6 LWP 6 0xef5b7488 in _poll () 5 LWP 5 0xef5b9814 in _lwp_sema_wait () 4 LWP 4 0xef5b9810 in _lwp_sema_wait () 3 LWP 3 0xef5b9810 in _lwp_sema_wait () 2 LWP 2 0xef5b9958 in _signotifywait () * 1 LWP 1 0xef5b9810 in _lwp_sema_wait () (gdb) thread 16 [Switching to Thread 7 (LWP 8)] #0 subtract_refs (containers=0x13dec8) at ./Modules/gcmodule.c:166 ./Modules/gcmodule.c:166: No such file or directory. (gdb) print *((PyObject *) gc)->ob_type $1 = {ob_refcnt = 18213696, ob_type = 0x2d70b0, ob_size = 0, tp_name = 0x1 "T", tp_basicsize = 1328272, tp_itemsize = 4156348, tp_dealloc = 0x125865c, tp_print = 0x3c1b04, tp_getattr = 0, tp_setattr = 0, tp_compare = 0x29, tp_repr = 0x3adeb0, tp_as_number = 0xf66198, tp_as_sequence = 0xdf3fa0, tp_as_mapping = 0x0, tp_hash = 0x1, tp_call = 0x144490 <PyMethod_Type>, tp_str = 0x3f0a1c, tp_getattro = 0x125865c, tp_setattro = 0x3c1b04, tp_as_buffer = 0x0, tp_flags = 158561192, tp_doc = 0x29 "", tp_traverse = 0x4c4f4144, tp_clear = 0xd908c0, tp_richcompare = 0x1151300, tp_weaklistoffset = 0} (gdb) print *((PyObject *) 0x2d70b0)->ob_type $2 = {ob_refcnt = 2977968, ob_type = 0xff5b80, ob_size = 0, tp_name = 0x1 "T", tp_basicsize = 1328272, tp_itemsize = 4155228, tp_dealloc = 0x125865c, tp_print = 0x3c1b04, tp_getattr = 0, tp_setattr = 0, tp_compare = 0x29, tp_repr = 0, tp_as_number = 0x1212b48, tp_as_sequence = 0xbf8d30, tp_as_mapping = 0xffffffff, tp_hash = 0x1, tp_call = 0x144490 <PyMethod_Type>, tp_str = 0x4ab2cc, tp_getattro = 0x1089d5c, tp_setattro = 0x4ab30c, tp_as_buffer = 0x0, tp_flags = 0, tp_doc = 0x29 "", tp_traverse = 0, tp_clear = 0x122d140, tp_richcompare = 0x11ccd70, tp_weaklistoffset = -1} gdb) x 0x4c4f4144 0x4c4f4144: Cannot access memory at address 0x4c4f4144.

3 2

DA connection pooling thoughts
by Brad Clements 12 Dec '01

12 Dec '01

Sorry if this is FAQ.. I've been reading the petrilli's DA how-to, and thinking about Thunked_TM. For Interbase, I'm thinking of trying a DB connection pool that threads can "checkout". That is, each DB connection is serialized to be used by one thread only, but there can be multiple DB connections in a Zope process. We'd maintain a pool of connections from 1 to n.. and each thread making a DA request checks out a DB connection from the pool (if available) and uses it.. I'm trying to figure out of Zope already does this, that is, has one DB connection per thread if I took out Thunked_TM from the DB itself. Or is it that there are multiple DA's, and the DA uses on internal DB for all the DA's ? If Zope will re-entrantly call a DA and it's corresponding DB without Thunked_TM in- place, then having a connection pool (up to one for each thread) might be worthwhile.. I remember seeing something on the list about per-thread state information being available somewhere.. an oid jar or something? Anyone have pointers? Thanks Brad Clements, bkc(a)murkworks.com (315)268-1000 http://www.murkworks.com (315)268-9812 Fax netmeeting: ils://ils.murkworks.com AOL-IM: BKClements

2 1

Re: [Zope-dev] recipe for trapping SIGSEGV and SIGILL signals on solaris
by Joseph Wayne Norton 12 Dec '01

12 Dec '01

Matt - Well, your patch seems fine in our testing environment. Unfortunately, we do not see any restarts in the testing environment ... always in production. I had to rebuild our entire software base because we are using other products that use extensions class and they are not included under the main zope installation. It caused a bus error the first time (with only running wo_pcgi.py). As I mentioned in my prior e-mail, I modified the patch slightly to exactly match the struct in Python's object.h. Please review this patch. I will apply the patch in production tomorrow morning, 12/13, (Japan Standard Time or GMT+9) and monitor the system. If zope does not restart during the day, then I think you have fixed the problem. I'm using Zope 2.4.3 and Python 2.1.1 with pymalloc disabled on the solaris platform. thanks and regards, - joe n. p.s. I looked **briefly** at the Zope 2.5 source and this patch will not be compatible since there doesn't seem to be a standard among the different extension classes on whether to include or not include the COUNT_ALLOCS define. The cAccessControl class seems to be the exception. *** ExtensionClass.h.bak Fri Nov 16 10:37:11 2001 --- ExtensionClass.h Wed Dec 12 15:10:03 2001 *************** *** 136,154 **** PySequenceMethods *tp_as_sequence; PyMappingMethods *tp_as_mapping; ! /* More standard operations (at end for binary compatibility) */ hashfunc tp_hash; ternaryfunc tp_call; reprfunc tp_str; getattrofunc tp_getattro; setattrofunc tp_setattro; ! /* Space for future expansion */ ! long tp_xxx3; ! long tp_xxx4; char *tp_doc; /* Documentation string */ #ifdef COUNT_ALLOCS /* these must be last */ int tp_alloc; --- 136,169 ---- PySequenceMethods *tp_as_sequence; PyMappingMethods *tp_as_mapping; ! /* More standard operations (here for binary compatibility) */ hashfunc tp_hash; ternaryfunc tp_call; reprfunc tp_str; getattrofunc tp_getattro; setattrofunc tp_setattro; ! ! /* Functions to access object as input/output buffer */ ! PyBufferProcs *tp_as_buffer; ! ! /* Flags to define presence of optional/expanded features */ ! long tp_flags; char *tp_doc; /* Documentation string */ + /* call function for all accessible objects */ + traverseproc tp_traverse; + + /* delete references to contained objects */ + inquiry tp_clear; + + /* rich comparisons */ + richcmpfunc tp_richcompare; + + /* weak reference enabler */ + long tp_weaklistoffset; + #ifdef COUNT_ALLOCS /* these must be last */ int tp_alloc; *************** *** 302,308 **** { PyExtensionClassCAPI->Export(D,N,&T); } /* Convert a method list to a method chain. */ ! #define METHOD_CHAIN(DEF) { DEF, NULL } /* The following macro checks whether a type is an extension class: */ #define PyExtensionClass_Check(TYPE) \ --- 317,330 ---- { PyExtensionClassCAPI->Export(D,N,&T); } /* Convert a method list to a method chain. */ ! /* MTK -- make it pad the type structure out -- presumes only use is in ! ** type structure initialization ! */ ! #ifdef COUNT_ALLOCS ! #define METHOD_CHAIN(DEF) 0,0,0,0,0,0,0,0,{ DEF, NULL } ! #else ! #define METHOD_CHAIN(DEF) 0,0,0,0,{ DEF, NULL } ! #endif /* The following macro checks whether a type is an extension class: */ #define PyExtensionClass_Check(TYPE) \ *************** *** 336,342 **** #define PURE_MIXIN_CLASS(NAME,DOC,METHODS) \ static PyExtensionClass NAME ## Type = { PyObject_HEAD_INIT(NULL) \ 0, # NAME, sizeof(PyPureMixinObject), 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, \ ! 0, 0, 0, 0, 0, 0, 0, DOC, {METHODS, NULL}, \ EXTENSIONCLASS_BASICNEW_FLAG} /* The following macros provide limited access to extension-class --- 358,364 ---- #define PURE_MIXIN_CLASS(NAME,DOC,METHODS) \ static PyExtensionClass NAME ## Type = { PyObject_HEAD_INIT(NULL) \ 0, # NAME, sizeof(PyPureMixinObject), 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, \ ! 0, 0, 0, 0, 0, 0, 0, DOC, METHOD_CHAIN(METHODS), \ EXTENSIONCLASS_BASICNEW_FLAG} /* The following macros provide limited access to extension-class

2 1