- Zope-Dev - Zope lists

nasty persistence problem
by Tim McLaughlin 19 Oct '01

19 Oct '01

I seem to be in a bad spot. When I restarted Zope after modifying some products, I got a "Could not load oid.." for all URLs. Basically, the only way I could even access anything was by doing an "import Zope" in the Python interpreter and deleting acl_users which is an instance of LoginManager. And now I found out (once I was able to login to ZMI) that two vital ZClasses are broken also. So, I'm kinda stuck. Here's the error: Error Type: Could not load oid ~, pickled data in traceback info may contain clues Error Value: None Here's the traceback if it helps... Traceback (innermost last): File /zope/lib/python/ZPublisher/Publish.py, line 223, in publish_module File /zope/lib/python/ZPublisher/Publish.py, line 187, in publish File /zope/lib/python/Zope/__init__.py, line 226, in zpublisher_exception_hook (Object: LockableItem) File /zope/lib/python/ZPublisher/Publish.py, line 171, in publish File /zope/lib/python/ZPublisher/mapply.py, line 160, in mapply (Object: manage_main) File /zope/lib/python/ZPublisher/Publish.py, line 112, in call_object (Object: manage_main) File /zope/lib/python/Shared/DC/Scripts/Bindings.py, line 324, in __call__ (Object: manage_main) File /zope/lib/python/Shared/DC/Scripts/Bindings.py, line 354, in _bindAndExec (Object: manage_main) File /zope/lib/python/App/special_dtml.py, line 241, in _exec (Object: manage_main) File /zope/lib/python/DocumentTemplate/DT_In.py, line 711, in renderwob (Object: objectItems) File /zope/lib/python/DocumentTemplate/DT_In.py, line 839, in sort_sequence (Object: objectItems) File /zope/lib/python/ZODB/Connection.py, line 544, in setstate File /zope/lib/python/ZODB/Connection.py, line 227, in _persistent_load (Info: ('\x00\x00\x00\x00\x00\x00\x17~', '(cExtensionClass\nExtensionClass\nq\x01(U\x07Sectionq\x02(cZClasses.ZClass\nPersistentClass\nq\x03cZClasses.ObjectManager\nObjectManager\nq\x04cOFS.SimpleItem\nSimpleItem\nq\x05tq\x06}q\x07(U\x04iconq\x08U1Control_Panel/Products/Content/Section/ziconImageq\tU\n_p_changedq\nK\x01U\x07__doc__q\x0bU\x07Sectionq\x0cU\x08positionq\rK\x00U\x14_v_manage_path_rolesq\x0eU\x0fContent/Sectionq\x0fU\x06_p_oidq\x10U\x08\x00\x00\x00\x00\x00\x00\x17~q\x11U\nziconImageq\x12(U\x08\x00\x00\x00\x00\x00\x00\x17\x95q\x13(U\tOFS.Imageq\x14U\x05Imageq\x15ttQU\tmeta_typeq\x16U\x07Sectionq\x17U\nmeta_typesq\x18(}q\x19(U\npermissionq\x1aU\x0cAdd Sectionsq\x1bU\x04nameq\x1cU\x07Sectionq\x1dU\x07productq\x1eU\x07Contentq\x1fU\x06actionq U)manage_addProduct/Content/Section_factoryq!u}q"(h\x1aU\x10Add NewsSectionsq#h\x1cU\x0bNewsSectionq$h\x1eh\x1fh U-manage_addProduct/Content/NewsSection_factoryq%u}q&(h\x1aU\tAdd Pagesq\'h\x1cU\x04Pageq(h\x1eU\x07Contentq)h U&manage_addProduct/Content/Page_factoryq*u}q+(U\npermissionq,U\x10Add ItemSectionsq-U\x04nameq.U\x0bItemSectionq/U\x07productq0U\x07Contentq1U\x06actionq2U-manage_addProduct/Content/ItemSection_factoryq3u}q4(U\npermissionq5U\x13Add CatalogSectionsq6U\x04nameq7U\x0eCatalogSectionq8U\x07productq9U\x07Contentq:U\x06actionq;U0manage_addProduct/Content/CatalogSection_factoryq<u}q=(U\nvisibilityq>U\x06Globalq?U\ninterfacesq@]qA(cInterface.iclass\nInterface\nqBoqC}qD(U\x11_Interface__attrsqE}qF(U\nwl_getLockqG(cInterface.Method\nMethod\nqHo}qI(U\x07__doc__qJU6 Returns the locktoken identified by the locktokenuri qKU\x08optionalqL}qMU\x08requiredqN(U\tlocktokenqOtU\x08__name__qPU\nwl_getLockqQU\tinterfaceqRU\x12WriteLockInterfaceqSU\x07varargsqTNU\x06kwargsqUNU\npositionalqV(hOtubU\rwl_lockValuesqW(hHo}qX(hJU_ Returns a sequence of locks. if \'killinvalids\' is true,\n invalid locks will be deletedqYhL}qZU\x0ckillinvalidsq[K\x00shN)hPU\rwl_lockValuesq\\hRhShTNhUNhV(h[tubU\nwl_hasLockq](hHo}q^(hJUU Returns true if the lock identified by the token is attached\n to the object. q_hL}q`h[K\x00shN(U\x05tokenqa.... and on and on for a while. -- Tim McLaughlin iterationZERO - www.iterationzero.com 703.481.2233

4 6

Zope server hanging
by sf＠fermigier.com 19 Oct '01

19 Oct '01

Hi, I've sent this message yesterday to the EuroZope list but got not conclusive answer: The eurozope.org Zope instance was down again this morning due to the same recurring problem as last week: 2001-10-18T02:32:52 ERROR(200) ZServer uncaptured python exception, closing channel <select-trigger (pipe) at 81e28c4> (exceptions.OSError:[Errno 11] Resource temporarily unavailable [/home/eurozope/Zope-2.4.1-linux2-x86/lib/python2.1/asyncore.py|poll|95] [/home/eurozope/Zope-2.4.1-linux2-x86/lib/python2.1/asyncore.py|handle_read_event|383] [/home/eurozope/Zope-2.4.1-linux2-x86/ZServer/medusa/thread/select_trigger.py|handle_read|77] [/home/eurozope/Zope-2.4.1-linux2-x86/lib/python2.1/asyncore.py|recv|335] [/home/eurozope/Zope-2.4.1-linux2-x86/lib/python2.1/asyncore.py|recv|517]) Notes: OS = Linux 2.2.19. start file = ------------------------------------------------------------------------------ #! /bin/sh reldir=`dirname $0` INST_HOME=`cd $reldir; pwd` export INST_HOME STUPID_LOG_FILE=$INST_HOME/var/stupid_log_file.log export STUPID_LOG_FILE exec /home/eurozope/Zope-2.4.1-linux2-x86/bin/python \ $INST_HOME/z2.py \ -l /dev/null -P8400 "$@" ------------------------------------------------------------------------------ (The bug happens even without '-l /dev/null'). Apache config = ------------------------------------------------------------------------------ ServerName www.eurozope.org ServerAlias eurozope.org ServerAlias eurozope.com ServerAlias www.eurozope.com CustomLog logs/eurozope.org-access_log combined RewriteEngine On RewriteRule ^/(.*) http://localhost:8480/eurozope.org/$1 [P,l] ------------------------------------------------------------------------------ Of course, the bug doesn't happen when I'm stressing the server with Apache Bench or a similar tool. It just happens *sometimes* (not once in 6 months, then twice in one week) on the live server. Does anyone here know what's going on ? It seems to me that this bug has been around for more than a year. Regards, S. -- Stéfane Fermigier, Tel: +33 (0)6 63 04 12 77 (mobile). http://nuxeo.com/ & http://portalux.com/ & http://aful.org/

1 0

ZCatalog UnpickleableError
by brian.r.brinegar.1 18 Oct '01

18 Oct '01

Under a 2.4.1 install I recieve the following error while trying to add a ZCatalog. Traceback (innermost last): File /data/www/Zope/src/Zope-2.4.1-src/lib/python/ZPublisher/Publish.py, line 223, in publish_module File /data/www/Zope/src/Zope-2.4.1-src/lib/python/ZPublisher/Publish.py, line 187, in publish File /data/www/Zope/src/Zope-2.4.1-src/lib/python/Zope/__init__.py, line 226, in zpublisher_exception_hook File /data/www/Zope/src/Zope-2.4.1-src/lib/python/ZPublisher/Publish.py, line 175, in publish File /data/www/Zope/src/Zope-2.4.1-src/lib/python/Zope/__init__.py, line 240, in commit File /data/www/Zope/src/Zope-2.4.1-src/lib/python/ZODB/Transaction.py, line 302, in commit File /data/www/Zope/src/Zope-2.4.1-src/lib/python/ZODB/Connection.py, line 418, in commit (Info: (('Products.PluginIndexes.TextIndex.GlobbingLexicon', 'GlobbingLexicon'), '\x00\x00\x00\x00\x00\t\xb1\xac', '')) UnpickleableError: Cannot pickle <type 'module'> objects Any hints on debugging/fixing the problem? --Brian Brinegar ECN Web Technician MSEE 104 A 494-3106 http://www.geeksoft.net/

1 0

ZCatalogIndexes
by brian.r.brinegar.1 18 Oct '01

18 Oct '01

A bug in ZCatalog/dtml/manageIndex.dtml prevents users from adding Indexes without having JavaScript enabled. The manageIndex.dtml form submits to addIndexForm which was used before PluginIndexes (2.4 I think). ZCatalog/dtml/addIndexForm.dtml is no longer needed ZCatalog/dtml/manageIndex.dtml needs the following changes to work without javascript: line 75: <form action="addIndexForm" method="get"> Change to: <form action="&dtml-absolute_url;" method="get"> line 77: <select class="form-element" name="index_type" Change to: <select class="form-element" name=":action" This fixes the problem. --Brian Brinegar ECN Web Technician MSEE 104 A 494-3106 http://www.geeksoft.net/

2 1

HELP PLEASE
by Andre Schubert 18 Oct '01

18 Oct '01

Hi all, i have serious problems with my zope. Last time he dies very often with error code 13,and since to today he slows down extremly. To view the Control_Panel/DebugForm it takes up to 1 minute and thats not acceptable. How can i track down these problems. I run Zope-2.2.4 on Immunix-RedHat 6.2 thanks a lot as

3 6

ZCatalogIndexes
by brian.r.brinegar.1 17 Oct '01

17 Oct '01

I was a little off in my previous fix: Line 75 in ZCatalog/dtml/manageIndex.dtml should be: <form action="&dtml-absolute_url;Indexes/" method="get"> Without the "Indexes/" at the end of the action indexes still get added, however the form submits back to the Contents of the ZCatalog instead of the index listing. Sorry, --Brian Brinegar ECN Web Technician MSEE 104 A 494-3106 http://www.geeksoft.net/

1 0

Appropriateness of using ZODB transactions to sync databases
by Ross Boylan 17 Oct '01

17 Oct '01

I am working on a membership application for a voluntary organization. The database may be updated either by the national office or local chapters. For security, convenience, and hosting reasons it seems best that locals work off their own copy of the database. Periodically changes will need to be syncronized, in both directions. I know that ZODB logs transactions. Is exchanging transactions a reasonable way to accomplish the syncronization? If so, exactly how do I go about grabbing them (it would be "all since date x") and then replaying them? Thanks.

1 0

Re: [Zope-dev] Zope & Cygwin
by Oliver Bleutgen 17 Oct '01

17 Oct '01

> I think the main reason for bad performance of any network related > application under Cygwin is the network layer. My observation is > that network is usually 10 to 25% of the normal throughput under Windows. > I have also seen that Cgywin performs slower on Windows 2000 than on > Windows ME. Jupp, I think so too (about network performance). As I understood, the whole thread started with an argument that perhaps no native zope port for windows is needed because of cygwin. I would say, as Chris, for development, this is ok, for production not, the quote from the apache site indicates this. I doubt zope corp. would accept a 30% tradeoff on windows. Ok, now let's discuss how feasible windows is for a production server anyway ;-). cheers, oliver

1 0

Re: [Zope-dev] Zope & Cygwin
by Oliver Bleutgen 17 Oct '01

17 Oct '01

> Hope it's OK to continue crossposting this thread. >> also of note >> http://apache.dev.wapme.net > Grabbed the bindist earlier today. ;-) I wanted to torture test the Zope > session manager under the cygwin-built Zope using ab, which is good > real-world threading test. It appears that neither ab nor wget much like > something about their communication with the cygwin-built Zope. Here's a > wget session with a cygwin-built python/Zope combo: One thing I haven't seen mentioned is that cygwin seems to impose a noticeable performance hit for an application running under it, compared to a "native" port. See for instance http://httpd.apache.org/docs/cygwin.html "Apache still performs best, and is most reliable, on Unix platforms. First benchmarks have shown that the same Apache setup on Cygwin performs about 30% slower than the corresponding native Windows version." cheers, oliver

3 2

RestrictedPython under no-GC 2.1 seems to leak a hell of a lot.
by Anthony Baxter 17 Oct '01

17 Oct '01

Running current Zope 2.4 CVS under python 2.1 built --without-cycle-gc, I'm seeing an absolutely _enormous_ amount of leaked objects in RestrictedPython. This is on one of our ZEO clients, after 45 minutes of runtime. The deltas are after 5 minutes. RestrictedPython.compiler.transformer.Transformer 146527 163546 +17019 RestrictedPython.compiler.visitor.ASTVisitor 55842 62333 +6491 RestrictedPython.compiler.misc.Set 34827 38843 +4016 RestrictedPython.compiler.pyassem.FlowGraph 19173 21413 +2240 RestrictedPython.compiler.ast.Stmt 19174 21390 +2216 RestrictedPython.compiler.pycodegen.CodeGenerator 18333 20486 +2153 RestrictedPython.compiler.symbols.SymbolVisitor 15303 17096 +1793 RestrictedPython.compiler.ast.Name 13917 15542 +1625 RestrictedPython.compiler.ast.Const 14083 15691 +1608 RestrictedPython.compiler.ast.CallFunc 13798 15405 +1607 RestrictedPython.MutatingWalker.MutatingWalker 11968 13360 +1392 RestrictedPython.compiler.ast.Return 11986 13371 +1385 RestrictedPython.compiler.ast.Function 11986 13371 +1385 RestrictedPython.RestrictionMutator.RestrictionMutator 11800 13166 +1366 RestrictedPython.compiler.pycodegen.LocalNameFinder 11028 12322 +1294 RestrictedPython.compiler.pyassem.Block 10226 11401 +1175 RestrictedPython.compiler.pyassem.PyFlowGraph 9587 10707 +1120 RestrictedPython.compiler.misc.Stack 9587 10703 +1116 RestrictedPython.compiler.ast.Module 9590 10698 +1108 RestrictedPython.compiler.ast.Global 5761 6433 +672 RestrictedPython.compiler.ast.Assign 5761 6433 +672 RestrictedPython.compiler.ast.AssName 5761 6433 +672 After around an hour of runtime, the various ZEO clients are chewing about 100M of virtual memory each, and growing at a fearsome fearsome rate... Is this just a "known problem, deal with it"? I can't just turn back on the garbage collector, as it's causing random segfaults (yes, I'm working on trying to fix this as I speak^H^H^H^H^Htype). Anthony

1 0