- Zope-Dev - Zope lists

ZSyncher and xml-rpc via firewalls
by Dylan Jay 02 Dec '02

02 Dec '02

I was needing to use ZSyncher via a proxy server in our firewall. I wrote a new transport to do this that you might want to incorporate into ZSyncher. Nice product btw. Very helpful for my setup. Any chance of getting it to synch bidirectionally? import urllib class AuthProxyTransport(xmlrpclib.Transport): '''Handles an HTTP transaction to an XML-RPC server via a http proxy and using basic authentication djay(a)slarken.org.au ''' def __init__(self, username=None, password=None): self.username = username self.password = password self.verbose = None self.has_ssl = 0 self.proxies = urllib.getproxies() def request(self, host, handler, request_body, verbose=0): # issue XML-RPC request import httplib # Override to use proxies realhost = None if self.proxies.has_key("http"): realhost = host proxy = self.proxies["http"] urltype, proxyhost = urllib.splittype(proxy) host, selector = urllib.splithost(proxyhost) h = httplib.HTTP(host) if realhost: h.putrequest("POST", "http://" + realhost + handler) else: h.putrequest("POST", handler) # required by HTTP/1.1 if realhost: h.putheader("Host", realhost) else: h.putheader("Host", host) # required by XML-RPC h.putheader("User-Agent", self.user_agent) h.putheader("Content-Type", "text/xml") h.putheader("Content-Length", str(len(request_body))) #Override to do authentication (should really use username and password encoded in url like urllib) if self.username is not None and self.password is not None: h.putheader("AUTHORIZATION", "Basic %s" % string.replace( encodestring("%s:%s" % (self.username, self.password)), "\012", "")) h.endheaders() if request_body: h.send(request_body) errcode, errmsg, headers = h.getreply() if errcode != 200: raise xmlrpclib.ProtocolError( host + handler, errcode, errmsg, headers ) return self.parse_response(h.getfile())

1 0

ZLog, warnings module and deprecation warnings
by Yuppie 30 Nov '02

30 Nov '02

Hi! Two questions regarding Zope coding conventions: 1.) Should each deprecated function have a deprecation warning? 2.) Should I use ZLog or the python warnings module? TIA, Yuppie

1 0

[ANN] Proposal for better support of international dateforms in DateTime
by Andreas Jung 29 Nov '02

29 Nov '02

http://dev.zope.org/Wikis/DevSite/Proposals/BetterEuropeanDateTimeSupport Feel free to comment. Cheers, Andreas --------------------------------------------------------------------- - Andreas Jung http://www.andreas-jung.com - - EMail: andreas at andreas-jung.com - - "Life is too short to (re)write parsers" - ---------------------------------------------------------------------

1 0

KeywordIndex errors
by Chris Withers 28 Nov '02

28 Nov '02

Hi, started seeing quite a few of these showing up in one of our server's logs: ------ 2002-11-27T16:16:26 ERROR(200) KeywordIndex unindex_object could not remove documentId -869933785 from index companies. This should not happen. exceptions.KeyError: -869933785 This is Zope 2.6.0, hence the total lack of traceback :-( Anyone got any idea what's going on here? cheers, Chris

5 7

ZEO: Abundant POSKeyErrors after packing
by Jo Meder 28 Nov '02

28 Nov '02

Our setup is: Zope 2.6, Python 2.1.3, ZEO from CVS (http://cvs.zope.org/ZEO/?only_with_tag=ZODB3-3_1-branch) This morning we encountered a baffling phenomenon. A cron job routinely packs Data.fs by calling the appropriate URL via wget. 52 minutes after packing was completed we noticed a rapid succession of POSKeyError messages in our logs. Attached are 2 typical ones. Note that every traceback from ZODB.FileStorage.modifiedInVersion was directly follow by a (corresponding?) traceback in ZEO.zrpc.connection.call. Also every POSKeyError was transient. Enough patience in reloading the requested page always resulted in a complete rendering. Stopping Zope and ZEO processes and restarting them "solved" the problem completely. Any guesses? Perhaps a ZEO-version more appropriate for Zope 2.6? -------------------------------------- 2002-11-28T08:40:40 INFO(0) zrpc:23837 zeoLoad() raised exception: 0000000000028438 Traceback (innermost last): Module ZEO.zrpc.connection, line 226, in handle_request Module ZEO.StorageServer, line 308, in zeoLoad Module ZODB.FileStorage, line 663, in modifiedInVersion POSKeyError: 0000000000028438 2002-11-28T08:40:40 ERROR(200) ZODB Couldn't load state for '\x00\x00\x00\x00\x0 0\x02\x848' Traceback (innermost last): Module ZODB.Connection, line 507, in setstate Module ZEO.ClientStorage, line 516, in load Module ZEO.ServerStub, line 73, in zeoLoad Module ZEO.zrpc.connection, line 322, in call POSKeyError: 0000000000028438 -------------------------------------- Jo. -- Internetmanufaktur Jo Meder ---------------------- Berlin, Germany http://www.meder.de/ ------------------- fon: ++49-30-417 17 63 33 Kollwitzstr. 75 ------------------------ fax: ++49-30-417 17 63 45 10435 Berlin --------------------------- mob: ++49-170- 2 98 89 97 Public GnuPG-Key ---------- http://www.meder.de/keys/jo-pubkey.txt

1 0

Re: Zope-Dev -- confirmation of subscription -- request 616673
by Phil Harris 27 Nov '02

27 Nov '02

On Wed, 27 Nov 2002 05:54:27 -0500 zope-dev-request(a)zope.org wrote: > Zope-Dev -- confirmation of subscription -- request 616673 > > We have received a request from 193.63.123.17 for subscription of your > email address, <phil(a)harris-family.info>, to the zope-dev(a)zope.org > mailing list. To confirm the request, please send a message to > zope-dev-request(a)zope.org, and either: > > - maintain the subject line as is (the reply's additional "Re:" is > ok), > > - or include the following line - and only the following line - in the > message body: > > confirm 616673 > > (Simply sending a 'reply' to this message should work from most email > interfaces, since that usually leaves the subject line in the right > form.) > > If you do not wish to subscribe to this list, please simply disregard > this message. Send questions to zope-dev-admin(a)zope.org. >

1 0

Re: [Zope-dev] Moving forward with Zope 2.7
by THoffman＠indtech.wa.gov.au 27 Nov '02

27 Nov '02

Hi Could we get the Install and Configuration proposal cleaned up, with so many comments it's not clear what the actual proposal proposes to deliver now. Also parts of it's problem statement are just plain wrong. I currently have many (read every version of Zope including Alpha's and Betas since 2.4.1b1) installed on the same box, and I have 18 instances of which at least 8 are running concurrently on our dev box, currently using at least 2 different versions of Zope (2.5.1 and 2.6.0). (Some of the non running instances if I started them up would be on 2.4.3 etc.. Currently we can do everything listed as a problem in the proposal, it is clean, neat and everything is in it's place. (except maybe item 5 in the problem statement) Regards Tim On Tue, 2002-11-26 at 04:12, Brian Lloyd wrote: > > Is there already a schedule for Zope 2.7? (of course there is not :-) ) > > Now there is :) > > http://dev.zope.org/Wikis/DevSite/Projects/Zope2.7/FrontPage > > I've updated this project and tried to dispel any lingering > confusion over the earlier effort labelled "Zope 2.7". > > > > I proposed to include reStructuredText into Zope 2.7. This stuff is > > ready to be merged. If there are no objections I will merge it soon > > since there were only positive votes for the inclusion. > > Please don't merge anything until people have had a chance to see > what's going on and gotten the plan finalized. > > Per the plan above, I'd like for there to be a (relatively short) period > for people to volunteer and add proposals to the plan, followed by a process > of prioritizing and coming to closure on what will / won't be included. I > propose in the wiki that we should probably schedule an IRC day to do that. > > > Brian Lloyd brian(a)zope.com > V.P. Engineering 540.361.1716 > Zope Corporation http://www.zope.com > > > > > _______________________________________________ > Zope-Dev maillist - Zope-Dev(a)zope.org > http://lists.zope.org/mailman/listinfo/zope-dev > ** No cross posts or HTML encoding! ** > (Related lists - > http://lists.zope.org/mailman/listinfo/zope-announce > http://lists.zope.org/mailman/listinfo/zope ) DISCLAIMER: This email, including any attachments, is intended only for use by the addressee(s) and may contain confidential and/or personal information and may also be the subject of legal privilege. Any personal information contained in this email is not to be used or disclosed for any purpose other than the purpose for which you have received it. If you are not the intended recipient, you must not disclose or use the information contained in it. In this case, please let me know by return email, delete the message permanently from your system and destroy any copies. Emails and their attachments may be interfered with, may contain computer viruses or other defects and may not be successfully replicated on other systems. All attachments are opened at the recipient's risk.

9 18

Re: [Zope] MailHost from 2.5.1 does not work in 2.6.0, was: Script from 2.5.1 does not work with 2.6.0
by Lennart Regebro 26 Nov '02

26 Nov '02

From: "Clemens Robbenhaar" <robbenhaar(a)espresto.com> > I guessed a little hint about this incompatibility in the release notes > would have been nice, but I can find nothing in this regard. I don't think anybody really was aware of it... :-/ It has to be fixed to 2.6.1 of course. The question is: Should the fix be to cast the smtp_port into an int every use (simple, functional, safe, ugly) or something else? > Did I miss some place to look at, or should the release notes possibly > be improved with respect to this? I checked some history. Up to 2.4 it was stored as an integer. For some reason it was changed between the final 2.5 beta and 2.5 release to be stored as a string, and then cast into an integer each time it was used. I don't know the rationale behind this change. However, the current MailHost is first appeared as a fix for several header problems I had already back in Zope 2.3, and this is probably why this change between 2.4 and 2.5 wasn't caught by the 2.6 MailHost. I based it on a 2.5 beta MailHost and must simply have missed this change, or at least not realized the effects of it.

2 1

Weird BTrees/ZODB interaction under Solaris
by Andreas Jung 26 Nov '02

26 Nov '02

I made the following reproducable observation running Zope 2.5 under Solaris: I was indexing a CMF site using TextIndexNG with about 1600 objects. During the commit phase (after all objects were indexed), the Zope process grow from about 100MB to more than 1.2GB. I could track this down to TextIndexNG. There is a function written in C that inserts the list of splittet words into the BTrees for the forward and reverse index (by generating the WordIDs internally). Replacing this method with a pure Python implementation made Zope behave fine. Torturing the corresponding C implementation in an isolated environment did not show any memory leaks (neither under Solaris nor under Linux i386). To make it short: my C implementation has three args: the forward index, the reverse index and a list of words to be inserted. The indexes are an OIBTree and an IOBTree. Internally I call PyObject_SetItem() to store the word-wid mapping. This seems to work fine isolated but seems to blow up the ZODB for unknown reasons. Note that his behaviour is only reproducable under Solaris. I made some tests by indexing about 100.000 docs under Linux with TextIndexNG and the Zope memory usage was very fine (up to 150MB). Cheers, Andreas --------------------------------------------------------------------- - Andreas Jung http://www.andreas-jung.com - - EMail: andreas at andreas-jung.com - - "Life is too short to (re)write parsers" - ---------------------------------------------------------------------

3 3

(Zope 2.6) Buglett in ZODB.ConflictResolution (missing import)
by Jo Meder 26 Nov '02

26 Nov '02

Just stumbled across a traceback in the logs that looks like a small bug in ZODB.ConflictResolution. In line 81 there's a reference to sys.exc_info() but sys is never imported in this module. Jo. -- Internetmanufaktur Jo Meder ---------------------- Berlin, Germany http://www.meder.de/ ------------------- fon: ++49-30-417 17 63 33 Kollwitzstr. 75 ------------------------ fax: ++49-30-417 17 63 45 10435 Berlin --------------------------- mob: ++49-170- 2 98 89 97 Public GnuPG-Key ---------- http://www.meder.de/keys/jo-pubkey.txt

1 0