- Zope-Dev - Zope lists

Zope and PIL problems?
by Townsend Duong 14 Apr '00

14 Apr '00

Is anybody else having problems getting Zope and PIL to work together? I'm trying to get Zope to use PIL to generate some images and load them into the Zope database. PIL claims it can't find the font file (or the glyph file). After hunting this bug for a while, I discovered that it has the file just fine, but it can't seem to open the glyph file because the line 'return factory(fp, filename)' in Image.open leads to an IOError. I tried ignoring the font problem temporarily, but then I got errors with the Image.save. It leads to ImageFile._save, which brings up an attribute error. Both open and save work fine from the command line 'interactive mode', and I've been able to get PIL to do these sorts of operations outside of Zope. I even loaded the font from the command line while Zope kept complaining. In case it helps, I'm using Zope 2.1.6, Python 1.5.2, PIL 1.0 final, and PILGraph 0.1a7. TD *--------------------------------------* | Townsend Duong | | Stanford University Computer Science | | beehive elektronische medien GmbH | | Handy: 0178 / 33 77 77 6 | | Email: townsend(a)beehive.de | *--------------------------------------*

1 0

Creating ExtensionClass instances in C
by Andrew M. Kuchling 14 Apr '00

14 Apr '00

Here's a simple question about the ExtensionClass API: if I write an ExtensionClass, how do I create an instance of it from C code? There's no obvious API function that does this... --amk

3 2

RE: [Zope] Re: Zope hanging (poss. threads-related)
by Marcus Collins 13 Apr '00

13 Apr '00

> -----Original Message----- > From: Tres Seaver [mailto:tseaver@palladion.com] > Sent: 13 April 2000 04:11 > To: zope-dev(a)zope.org > Cc: Monty Taylor; Michel Pelletier; Marcus Collins; Chris McDonough; > Amos Latteier; Jim Fulton; Brian Lloyd > Subject: Re:[Zope] Re: Zope hanging (poss. threads-related) Firstly, it's great to see the involvement of all these brains! Thanks to all of you! Secondly, sorry for the cross-posting... please don't hang me ;-) > I would *really* like for us to capture the information > flowing through the list in some less ephemeral form, so I have set up > a Wiki for discussing this and other availability/stability/ > reliability issues at: > http://www.zope.org/Members/tseaver/Projects/HighlyAvailableZope/ Tres, I also agree that this should not get lost amongst all the regular traffic. This list is busy enough as it is. However, perhaps other folk (Jerome Alet, others?) are just now beginning to say "me too", and so the rest of the list does need a chance to be involved. Not everyone is a member at zope.org either, and perhaps not everyone understands how Wiki works. It can also prove difficult, unless someone is moderating the posts, to not get tangled, whereas a threading mail client... this is basically just the same argument as was levelled about a week ago at the suggestion of using Wiki for bug tracking. Wiki is a fine thing, but I noticed now, when www.zope.org was back up, that despite having logged in, as soon as I when to the above URL, I was "Guest" again, and unable to annotate the discussion... (no "edit" link, etc.) Maybe this is a symptom of operator failure? For now, however, I'll continue CC'ing the zope list, unless you specifically wish it to be shunted to the zope-dev list? Maybe the other zope users have an opinion on this as well? Thanks for taking the initiative in this regard, thanks to all at DC for the ongoing support, and thanks to the list for their reports! Let's all continue together towards the solution! -- Marcus

3 2

Can I create dtml to calculate a date 30 days ago?
by jpenny＠universal-fasteners.com 13 Apr '00

13 Apr '00

I would like to do the following: <dtml-call "REQUEST.set('magicdate', DateTime()-days)"> where days is a variable set in a form in a higher level web page. It does not work, complains about "bad operand for unary -". Is there a way in DTML to do this? (And if so, what is it?). I am usually pretty good at trying quoting variants until I stumble accross one that works, but I just can't find it this time. Thanks Jim

2 1

Re: Invisible instance bug with Sub ZClasses
by Alexandre Ratti 13 Apr '00

13 Apr '00

Hi Jason, At 12:00 12/04/2000 -0700, you wrote: >Date: Wed, 12 Apr 2000 12:57:50 -0400 >From: Jason Spisak <444(a)hiretechs.com> >Subject: [Zope-dev] Invisible instance bug with Sub ZClasses >In the Collector, tickets [1178], [1175], [1161] all refer to the same >bug. This seems to be a pretty significant set back to anyone using >ZClass to create an application.(Which is probably a high percentage) Is >this holding anyone else's process up majorly? It's only a problem with >2.1.6. I haven't checked it against CVS, has anyone else? Alexandre? No; I was using Zope 2.1.4 when I first ran into the problem. I haven't tried with any CVS version. Cheers. Alexandre >Jason Spisak >444(a)hiretechs.com

1 0

Z2.py is dying...
by Fabio Augusto Mazzarino 13 Apr '00

13 Apr '00

Hello folks. After some weeks of hard work trying to install nisUserFolder I discoverd that we use md5 password encryptation. Then, after some hours I've modified this way: from this: def authenticate(self, password, request): domains=self.getDomains() person = match(self.name,'passwd.byname') vals = split(person, ':') if vals[1][-1] == '\n': #name:pwd\n pwd = vals[1][:-1] else: pwd = vals[1] #normal way salt = vals[1][:2] #ye old nisUserFolder w/o md5 secret = crypt(password, salt) if domains: return (secret==pwd) and domainSpecMatch(domains, request) return secret==pwd to this: def authenticate(self, password, request): domains=self.getDomains() person = match(self.name,'passwd.byname') vals = split(person, ':') if vals[1][-1] == '\n': #name:pwd\n pwd = vals[1][:-1] else: pwd = vals[1] #normal way if vals[1][:3] == '$1$': #md5 way delim = find(vals[1], '$', 3) salt = vals[1][:delim] #$1$salt else: salt = vals[1][:2] #ye old nisUserFolder w/o md5 #salt = vals[1][:2] #ye old nisUserFolder w/o md5 secret = crypt(password, salt) if domains: return (secret==pwd) and domainSpecMatch(domains, request) return secret==pwd And now Z2.py lasts no more than 5 minutes. It simply dies without any warning, without any message at all. What can I do to validate these users *and* make Zope work correctly (yes, it used to work before nisUserFolder modification). Thanx. Fabio Augusto Mazzarino - mazza(a)radiumsystems.com.br P.S.: What is past tense for to ping?

2 1

RE: [Zope] Re: Zope hanging (poss. threads-related)
by Amos Latteier 13 Apr '00

13 Apr '00

> > I'm actually wondering if reducing that zombie_timeout (and > > maintenance_interval in medusa/http_server.py) would go > anywhere towards > > alleviating this problem as a temporary measure. Would > there be any reasons > > not to try this? The ZServer zombie stuff is to get rid of zombie client connections, not zombie publishing threads. These are quite different beasts. > > Everything before the call to handle() is 100%. Sometimes, > however, we don't > > get from handle() to the next stage. This is on Zope 2.1.6, > which I've been > > running with up to 100 threads, although I unfortunately > can't excercise > > that many! In general there is little reason to have so many publishing threads. You almost never need that many unless you have a bunch of requests that can take a *long* time. If, on the other hand, you are trying to provoke some kind of thread contention issue I advise you to publish resources that take a long time to return. That way you can easily pile up as many publishing theads as you want to. > > I've added this logging to the Zope 2.1.3 serving the live > site, and will > > report my findings as soon as something untoward occurs. > Maybe others who > > are experiencing hanging would also be able to do some > extra logging and > > report the results [now, there, I see Wiki would be really useful!]. > > > > In the meantime, any suggestions as to where to go next > will be keenly acted > > on! In my experience when a Zope publishing thread hangs its almost always a problem with the published resource. Maybe there's something that puts Zope in a loop that never exits, or maybe there's some DA weirdness that hangs the thead. My advice is to try and identify which requests hang using debug logging and examine the resources that those requests use. -Amos -- Amos Latteier mailto:amos@digicool.com Digital Creations http://www.digicool.com

1 0

Re: [Zope] Re: Zope hanging (poss. threads-related)
by Tres Seaver 13 Apr '00

13 Apr '00

Marcus Collins wrote: > > I'm convinced there's some deep, dark, timing problem, and that it's > thread-related... > > This morning, I had a thread hang, again on Zope 2.1.3 running with four > threads. I was watching for unfinished requests at the time, and caught this > twenty minutes after it occurred. > > I tried viewing a frameset page on the site. No problem. Then I tried > launching /manage, and suddenly *all* the threads hung. This is the first > time all the threads have hung. It's also the first time I've managed to > catch an unfinished request and try viewing framesets within half an hour, > which leads me to believe that, previously, ZServer was doing a good job of > cleaning up the hung zombie threads (recall the zombie_timeout of 30 > minutes). > > I'm actually wondering if reducing that zombie_timeout (and > maintenance_interval in medusa/http_server.py) would go anywhere towards > alleviating this problem as a temporary measure. Would there be any reasons > not to try this? > > I've added quite a lot of DebugLogger stuff to ZServer/PCGIServer.py, and > modified the log analyser accordingly, in the hopes of nailing this sucker: > > def send_response(self): > # create an output pipe by passing request to ZPublisher, > # and requesting a callback of self.log with the module > # name and PATH_INFO as an argument. > self.done=1 > # MC 2000-04-13 additional logging > DebugLogger.log('X', id(self), 'send_response: before PCGIResponse') > response=PCGIResponse(stdout=PCGIPipe(self), stderr=StringIO()) > # MC 2000-04-13 additional logging > DebugLogger.log('X', id(self), 'send_response: before HTTPRequest') > request=HTTPRequest(self.data, self.env, response) > # MC 2000-04-13 additional logging > DebugLogger.log('X', id(self), 'send_response: before handle') > handle(self.server.module, request, response) > > Everything before the call to handle() is 100%. Sometimes, however, we don't > get from handle() to the next stage. This is on Zope 2.1.6, which I've been > running with up to 100 threads, although I unfortunately can't excercise > that many! In fact, it has proven quite a mission to get Zope to hang, maybe > because of the increased latency in serving requests due to the additional > logging. > > I've added this logging to the Zope 2.1.3 serving the live site, and will > report my findings as soon as something untoward occurs. Maybe others who > are experiencing hanging would also be able to do some extra logging and > report the results [now, there, I see Wiki would be really useful!]. > > In the meantime, any suggestions as to where to go next will be keenly acted > on! > > Thanks all! > > -- Marcus There is an outstanding Collector issue related to zombies: http://classic.zope.org:8080/Collector/871/view Amos, does this suggest anything? -- ========================================================= Tres Seaver tseaver(a)digicool.com tseaver(a)palladion.com

1 0

BadRAM: Linux kernel support for broken RAM modules
by Tres Seaver 13 Apr '00

13 Apr '00

This page supplies a kernel mod to deal with flaky DIMM's (ones with known "bad spots", detectable through Memtest86 or some such). http://home.zonnet.nl/vanrein/badram/ Memtest86 might be a good diagnostic for some of the weirder stability problems reported here. http://reality.sgi.com/cbrady_denver/memtest86/ Tres. -- ========================================================= Tres Seaver tseaver(a)digicool.com tseaver(a)palladion.com

1 0

Some thoughts on splitter
by Christian Wittern 13 Apr '00

13 Apr '00

Dear Zopistas, dear Michel, I have some thoughts on splitting text, mainly out of my experience with Chinese texts. 1. The handling of text should depend on some language tagging, similar to HTML4. This ensures that multilingual documents can be treated correctly. For backward compatibility, the default (in absence of a language tag) could be English, and of course the acquisition methods should be used to provide reasonable easy ways for multilingual sites to define the language once and be done with. 2. So far, automatic splitting algorithms have been able to reach 70-90% accuracy, depending on the type of texts, vocabulary and the day of the week. There are some systematic problems, that make it unlikely to see a 100% solution. Even the very good Chasen for splitting Japanese, which is used in JSplitter can not split Japanese with 100% accuracy. The bottomline of this is, there is a need to leave a door open for human intervention in finetuning the splitting. I would therefore think in the direction of a preprocessor to the splitter, that inserts spaces at places it thinks ok to split. This should be done upon importing text in Zope or upon the first save in edits of new text. People working with the texts could then finetune the splitting to avoid blunders. The Zope splitter could then happily just split at the spaces as usual. Of course, depending on the language settings, these spaces should be filtered out before the text is presented in normal view. 3. A completely different approach would be to forget about splitting and just index into every Asian character. Jim Breen employed this method in his Japanese-English dictionary EDICT (). This allows efficient retrieval of arbitrary strings. I am not sure however, how this would adopt to the kind of dynamic indexing required in Zope. All the best, Christian Dr. Christian Wittern Chung-Hwa Institute of Buddhist Studies 276, Kuang Ming Road, Peitou 112 Taipei, TAIWAN Tel. +886-2-2892-6111#65, Email chris(a)ccbs.ntu.edu.tw

2 1