- Zope - Zope lists

Help: My beloved Zope crashes
by Hanno Schlichting 01 Oct '03

01 Oct '03

Hi all. I've a serious problem and don't know where to look further for the error. Hope anyone can help. (Sorry for the crosspost.) My configuration: Hardware: 2x 750MHz, 1GB RAM Software: Windows 2000 SP4, Zope 2.6.2, CMF 1.3.2, Plone 1.0.5 and a variety of other products such as CMFForum, CMFCollector, CMFVisualEditor, Epoz, Photo and Photoalbum, TextindexNG, LocalFileSystem. Two weeks ago I upgraded to CMF 1.4.1 and a CVS Version of Plone 1.1 but undid (by overwritting with a backup copy of the whole zope directory) the changes because of some errors with the plone version. This might be unrelated but for one week knowing of no special changes my zope instance hangs everytime I change a document or try to add one. In detail: In the ZMI I try to change the content of a document. I click change and my browser gets no response. I can watch my zope instance collecting all free memory (~800MB) then suddenly releasing everything and then going into a cycle grabbing up to 40 MB going down to 0 and restarting this, the whole time with a processor load of 100 percent. It looks like some kind of infinite loop, but I have no idea what could cause this. I ran debug mode from the console but it tells me nothing. I ran fsrecover and fspack on the database file (about 400MB) but everything is fine. I assume something involved in the process of saving like the catalog or workflow might be the cause but I don't know how to track this down. Help of any kind is appreciated. Hanno Schlichting --- E-Mail: schlichting(a)bakb.net

2 1

Invalid Characters for a URL?
by Edward Pollard 01 Oct '03

01 Oct '03

I'm porting some data to a Zope environment, and it is critical that URL's remain the same. However, Zope does not allow plus signs (+) in URL's. It tries to pass it off that plus is an invalid character for a URL. However, plus is a perfectly valid character for a URL (ref: http://www.ietf.org/rfc/rfc1738.txt) So, why is Zope doing this, and much more importantly what does Zope think ARE valid characters for a URL? --- Edward J. Pollard University of Lethbridge Web Development

2 1

Re: [Zope] FTP server hangs on ls, put, get, ...
by Ian Beatty 01 Oct '03

01 Oct '03

On Tue, 30 Sep 2003 15:02:39 -0400, Paul Winkler <pw_lists(a)slinkp.com> is reputed to have said: > Is the server behind a firewall? > I've never been able to get ftp working through a firewall. Yes, it is. I've got Zope's FTP running on 8021 and that port in the firewall is open. Hmmm... I just tried turning off the firewall entirely, and FTP works. So maybe it's a firewall issue and not a Zope issue after all. My commercial service provider for a different Zope site I manage (Zettai.net) has FTP working, and they're very security conscious, so they must have figured out how to make it work. If anyone listening can tell me what firewall rules I'll need, I'd be grateful. Since it's no longer a Zope-specific issue, maybe you should just email me off-list. Thanks, ..Ian Beatty -- --- -- --- -- --- -- --- -- --- -- --- -- --- -- --- -- --- -- --- -- Dr. Ian Beatty webmaster(a)physics.umass.edu Webmaster, Department of Physics voice: 413.545.9483 Univ. of Massachusetts fax: 413.545.4884 Amherst, MA 01003-4525 USA http://www.physics.umass.edu/ -- --- -- --- -- --- -- --- -- --- -- --- -- --- -- --- -- --- -- --- --

3 2

RE: [Zope] Cataloging/ignoring objects that generate errors on in dexing
by Jean-Francois.Doyon＠CCRS.NRCan.gc.ca 01 Oct '03

01 Oct '03

OK, I've found the code that is causing this to happen: Zope 2.6.1, in Products/PluginIndexes/TextIndex/TextIndex.py, Line 291: except (AttributeError, TypeError): For some reason, the index_object method catches specific exceptions, not ALL exceptions. If I change this to a simple "except:", then my problem goes away. Conceptually, I would think this is better ... Just ignore ANY error that might occur and don't index the object ... Why only handle specific exceptions ? Is this a bug ? Thanks, J.F. -----Original Message----- From: Jean-Francois.Doyon(a)CCRS.NRCan.gc.ca [mailto:Jean-Francois.Doyon@CCRS.NRCan.gc.ca] Sent: Monday, September 29, 2003 1:15 PM To: chrism(a)zope.com Cc: zope(a)zope.org Subject: RE: [Zope] Cataloging/ignoring objects that generate errors on in dexing Hello, Here is the traceback, but in case that's confusing, find the code that modifies the CMF Document below as well: Traceback (innermost last): Module ZPublisher.Publish, line 49, in publish Module ZPublisher.mapply, line 32, in mapply Module ZPublisher.Publish, line 38, in call_object Module Products.ZCatalog.ZCatalog, line 292, in manage_catalogFoundItems Module Products.ZCatalog.ZCatalog, line 656, in ZopeFindAndApply Module Products.ZCatalog.ZCatalog, line 656, in ZopeFindAndApply Module Products.ZCatalog.ZCatalog, line 656, in ZopeFindAndApply Module Products.CMFCore.CatalogTool, line 226, in catalog_object Module Products.ZCatalog.ZCatalog, line 486, in catalog_object Module Products.ZCatalog.Catalog, line 299, in catalogObject Module Products.PluginIndexes.TextIndex.TextIndex, line 271, in index_object Module Products.Atlas, line 47, in SearchableText Module Products.Atlas, line 34, in CookedBody Module Shared.DC.Scripts.Bindings, line 250, in __call__ Module Shared.DC.Scripts.Bindings, line 270, in _bindAndExec Module Products.PageTemplates.ZopePageTemplate, line 198, in _exec Module Products.PageTemplates.PageTemplate, line 79, in pt_render <ZopePageTemplate at /english/learningresources/quizzes/questions.html/> Module TAL.TALInterpreter, line 196, in __call__ Module TAL.TALInterpreter, line 229, in interpret Module TAL.TALInterpreter, line 633, in do_loop_tal Module Products.PageTemplates.TALES, line 201, in setRepeat Module Products.PageTemplates.TALES, line 211, in evaluate URL: Line 5, Column 0 Expression: <PythonExpr here.quizquery(mode='getquestions',cat=int(request.form['category']),dif=int (request.form['difficulty']),limit=int(request.form['num']))> Names: {'container': <Document at /english/learningresources/quizzes/questions.html>, 'default': <Products.PageTemplates.TALES.Default instance at 0x8657204>, 'here': <Document at /english/learningresources/quizzes/questions.html>, 'loop': <SafeMapping instance at 94b8a60>, 'modules': <Products.PageTemplates.ZRPythonExpr._SecureModuleImporter instance at 0x8656fe4>, 'nothing': None, 'options': {'args': ()}, 'repeat': <SafeMapping instance at 94b8a60>, 'request': <HTTPRequest, URL=http://atlas.gc.ca/newsite/english/portal_catalog/manage_catalogFoundIte ms>, 'root': <Application instance at 8d0a9e8>, 'template': <ZopePageTemplate at /english/learningresources/quizzes/questions.html/>, 'traverse_subpath': [], 'user': admin} Module Products.PageTemplates.ZRPythonExpr, line 43, in __call__ __traceback_info__: here.quizquery(mode='getquestions',cat=int(request.form['category']),dif=int (request.form['difficulty']),limit=int(request.form['num'])) Module Python expression "here.quizquery(mode='getquestions',cat=int(request.form['category']),dif=in t(request.form['difficulty']),limit=int(request.form['num']))", line 2, in f Module AccessControl.ZopeGuards, line 75, in guarded_getitem KeyError: category And, in my product's __init__ , I have : # Monkey Patch to turn CMF Documents into ZPT's, give them Properties, and fix up the indexing to strip HTML originalCookedBody = Document.CookedBody originalManageOptions = Document.manage_options def CookedBody(self, stx_level=None, setlevel=0): # First, run through the original logic cookedbody = originalCookedBody(self, stx_level, setlevel) # Then if document is HTML, run it through the ZPT rendering engine if ( self.text_format == 'html' ): pt = ZopePageTemplate('',cookedbody,'text/html').__of__(self) cookedbody = pt() return cookedbody Document.CookedBody = CookedBody Document.manage_options = ( originalManageOptions + PropertyManager.manage_options ) def SearchableText(self): return "%s %s %s %s" % (self.Title(),self.Description(),stripper(self.CookedBody()),self.Keywords() ) Document.SearchableText = SearchableText ... The thought had occured to me that maybe the catalog only ignores certain types of exceptions, but I mean ... a KeyError is pretty standard, and precisely the kind of exception I'd expect the catalog to ignore. Maybe I can trap the erro and raise some other exception ? Or maybe there's a bug that exception handling isn't done right ? Thanks in advance for any help! J.F. -----Original Message----- From: Chris McDonough [mailto:chrism@zope.com] Sent: Friday, September 26, 2003 2:01 PM To: Jean-Francois.Doyon(a)CCRS.NRCan.gc.ca Cc: zope(a)zope.org Subject: Re: [Zope] Cataloging/ignoring objects that generate errors on indexing Can you supply a traceback? I've always been under the same impression as you.... On Fri, 2003-09-26 at 12:15, Jean-Francois.Doyon(a)CCRS.NRCan.gc.ca wrote: > Hello, > > I'm trying to update my catalog, and much to my surprise, it ain't working ! > > Some objects require form parameters and so on, raise errors when none are > provided. So now when I ask the catalog (In this case a CMF one, but the > fact it's CMF shouldn't really matter, right?) to index everything it can > find, it raises an error when it lands on such objects. > > Now this has never happened ot me before, and I'd always assumed that > objects that raised errors while being index simply didn't get indexed, > hence my suprise. I was actually counting on such doucments NOT getting > indexed BECAUSE they raise errors. > > Admitedly, I'm doing something somewhat out of the ordinary. I have a CMF > Document that actually renders/interprets TAL (Basically a CMF Document > ZPT). SearchableText() runs a CookedBody that does the ZPT rendering ... Of > course NOT using CookedBody at indexing might be an option, but I'm not sure > of the consequences ... Some documents that have simple > tal:replace/tal:content type instructions in them I DO want to have Cooked > before indexing ... > > Anybody have any good ways or suggestions on how to get around this ? > > Any help would be much appreciated! > > Thanks, > > Jean-François Doyon > Internet Service Development and Systems Support > GeoAccess Division > Canadian Center for Remote Sensing > Natural Resources Canada > http://atlas.gc.ca > Phone: (613) 992-4902 > Fax: (613) 947-2410 > > > _______________________________________________ > Zope maillist - Zope(a)zope.org > http://mail.zope.org/mailman/listinfo/zope > ** No cross posts or HTML encoding! ** > (Related lists - > http://mail.zope.org/mailman/listinfo/zope-announce > http://mail.zope.org/mailman/listinfo/zope-dev ) -- Chris McDonough <chrism(a)zope.com> Zope Corporation _______________________________________________ Zope maillist - Zope(a)zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )

2 1

TranslationService and charsets...
by Gilles Lenfant 01 Oct '03

01 Oct '03

Hi zopistas... I can translate a message with... translated = context.translation_service.translate('mydomain', message) But how can I get the charset of the translated message, as the various languages from the associated MessageCatalog may have different charsets (ASCII, ISOxxx,...). Many thanks in advance for any hint. --Gilles

2 2

Missing input variable
by Florian Lindner 01 Oct '03

01 Oct '03

Hello, I use this script with Simple User Folder. It's being called when a new user is added: ## Script (Python) "addUser" ##bind container=container ##bind context=context ##bind namespace= ##bind script=script ##bind subpath=traverse_subpath ##parameters=name, password, roles ##title= ## for role in roles: csv_role = csv_role + "," + role return context.addUser_test(name, password, roles) es soll aus der Liste roles einen CSV-string machen ( ['Manager','Owner'] -> 'Manager,Owner' This is the ZSQL-Method addUser_test: <params>name password roles</params> INSERT INTO users(name,password,role) VALUES (<dtml-sqlvar name type="string">,<dtml-sqlvar password type="string">,<dtml-sqlvar roles type="string">) But this raies an error when I try to add a user with the ZMI. Exception Type Missing Input Exception Value Missing input variable, <em>name</em> Traceback (innermost last): * Module ZPublisher.Publish, line 98, in publish * Module ZPublisher.mapply, line 88, in mapply * Module ZPublisher.Publish, line 39, in call_object * Module AccessControl.User, line 937, in manage_users * Module AccessControl.User, line 865, in _addUser * Module Products.SimpleUserFolder.SimpleUserFolder, line 93, in _doAddUser * Module Shared.DC.Scripts.Bindings, line 252, in __call__ * Module Shared.DC.Scripts.Bindings, line 283, in _bindAndExec * Module Products.PythonScripts.PythonScript, line 314, in _exec * Module Script (Python), line 4, in addUser <PythonScript at /centershock/addUser used for /centershock/acl_users> Line 4 * Module Shared.DC.ZRDB.DA, line 415, in __call__ * Module DocumentTemplate.DT_String, line 474, in __call__ * Module Shared.DC.ZRDB.sqlvar, line 99, in render Missing Input: Missing input variable, <em>name</em> All form-fields were filled in, what's the fault? Thanks, Florian

2 1

RE: [Zope] Re: Tracking upload of files to Zope
by Passin, Tom 01 Oct '03

01 Oct '03

[ Gitte Wange] > Browsers? > No ... they just load the new page - that's what make the > users think the > website has fallen into sleep and they start clicking all > sorts of things. > > > For every other approach, there is simply no channel in the > > HTTP-protocol to output the information to. > > > > So the question about how to get the information is completely > > secondary :-) > > Hmmm .. so Zope doesn't know how much data it has received ? > > > IF you want to watch uploads for debugging purpose, and files > > are huge, you can try "lsof" in the temp directory. I can imagine one way to do this, if you can get the number of bytes uploaded so far. It would be a bit cumbersome, though. Here goes - The command to start the upload opens a new window. That window has a meta element that causes the page to reload, say every five seconds. The page for the automatic reload displays the bytes uplaoded so far. When the upload is complete, the next reload has the window close itself (using javascript), or else it just announces that the upload is complete. Personally, I doubt that it is worth it. It is easier to load a static page that just says "upload in progress..." or something like that. Cheers, Tom P

2 1

Banner Grabbing
by D. Rick Anderson 01 Oct '03

01 Oct '03

How do we modify the 'Server' string in Zope? My boss is on a security kick, and somebody got him stuck on the term 'banner grabbing'. I just want to put something in there that doesn't identify the server or version. Thanks, Rick

5 11

batch update
by Mike Doanh Tran 01 Oct '03

01 Oct '03

Hi, I am trying to use DTML to allow batch update of multiple records to a mysql database. For simplicity i created five lists from a html form: one is the primary key id(pk_id), field1,field2,field3,field4. Here is what i want to do. I have an zSQL update method that looks like this: UPDATE test_database set field1=<dtml-sqlvar field1 type=string>, field2=<dtml-sqlvar field2 type=string> , field3=<dtml-sqlvar field3 type=string>, field4=<dtml-sqlvar field4 type=string> WHERE pk_id=<dtml-sqlvar pk_id type=nb> I want to interate over the above method to update multiple records. Basically i have five lists of data: pk_id,field1,field2,field3,field4 i am having a hard time trying to split these lists up using DTML so that the first item on each list correspond to the first item of the pk_id list, the second correspond to the second pk_id, and so on. Can anyone give me some hints on how to this? Thanks, Mike HTML Form: PK_ID Field1 Field2 Field3 Field4 1 f1 f2 f3 f4 2 f1.1 f2.1 f3.1 f4.1 <form action="updateData" method="post"> <dtml-in getData> <input type="text" name="pk_id:list" value="<dtml-var pk_id>"> <input type="text" name="field1:list" value=""> <input type="text" name="field2:list" value=""> </dtml-in> </form>

2 1

ZSyncer
by Sophia Grimm 30 Sep '03

30 Sep '03

When I synchronize using ZSyncer, very frequently the indicator text beside the folder still shows as "out of date" even though it is not (the date and content are correct). Is this typical? And what can I do? Because this happens, I am syncing a lot of folders that probably don't need it. Thanks. __________________________________ Do you Yahoo!? Yahoo! SiteBuilder - Free, easy-to-use web site design software http://sitebuilder.yahoo.com

5 5