July 2005 - Zope - Zope lists

Re: [Zope] Running more than one instance on windows often block each other
by Tim Peters 03 Aug '05

03 Aug '05

[Sune Brøndum Wøller] > Thanks for the pointer. I have been debugging > select_trigger.py, and has some more info: > > The problem is that the call a.accept() sometimes hangs. > Apparently a.bind(self.address) allows us to bind to > a port that another zope instance already is bound to. > > The code creates the server socket a, and the client socket w, > and gets the client socket r by connecting w to a. Then it closes a. > a goes out of scope when __init__ terminates, and is probably garbage > collected at some point. Unless you're using a very old Python, `a` is collected before the call returns (where "the call" means the call of the function in which `a` is a local variable). Very old Pythons had an idiotic __del__ method attached to their Windows socket wrapper, which inhibited timely gc. > I tried moving the code to the following standalone script, and I can reproduce > the error with that. In the original code w is kept as an instance variable, and > r is passed to asyncore.dispatcher.__init__ and probably kept there. Yes, the socket bound to `r` also gets bound to `self.socket` by this call: asyncore.dispatcher.__init__ (self, r) > I simulate that by returning them, then the caller of socktest can keep them > around. > > I try to call socktest from different processes A and B (two pythons): > (w,r = socktest()) > The call in A gets port 19999. The second call, in B, either blocks, or takes > over port 19999 (I see the second process taking over the port in a port scanner.) Sorry, I can't reproduce this -- but you didn't give a test program, just an isolated function, and I'm not sure what you did with it. I called that function in an infinite loop, appending the return value to a global list, with a short (< 0.1 second) sleep between iterations, and closed the returned sockets fifty iterations after they were created. Ran that loop in two processes. No hangs, or any other oddities, for some minutes. It did _eventually_ hang-- and both processes at the same time --with netstat showing more than 4000 sockets hanging around in TIME_WAIT state then. I assume I bashed into some internal Windows socket resource limit there, which Windows didn't handle gracefully. Attaching to the processes under the MSVC 6 debugger, they were hung inside the MS socket libraries. Repeated this several times (everything appeared to work fine until > 4000 sockets were sitting in TIME_WAIT, and then both processes hung at approximately the same time). Concretely: sofar = [] try: while 1: print '.', stuff = socktest() # calling your function sofar.append(stuff) time.sleep(random.random()/10) if len(sofar) == 50: tup = sofar.pop(0) w, r = tup msg = str(random.randrange(1000000)) w.send(msg) msg2 = r.recv(100) assert msg == msg2, (msg, msg2) for s in tup: s.close() except KeyboardInterrupt: for tup in sofar: for s in tup: s.close() Note that there's also a bit of code there to verify that the connected sockets can communicate correctly; the `assert` never triggered. You haven't said which versions of Windows or Python you're using. I was using XP Pro SP2 and Python 2.3.5. Don't know whether either matters. It was certainly the case when I ran it that your > print port statement needed to display ports less than 19999 at times, meaning that the > a.bind((host, port)) did raise an exception at times. It never printed a port number less than 19997 for me. Did you ever see it print a port number less than 19999? > a.bind in B does not raise socket.error: (10048, 'Address already in use') as > expected, when the server socket in A is closed, even though the port is used by > the client socket r in A. I'm not sure what that's saying, but could be it's an illusion. For example, >>> import socket >>> s = socket.socket() >>> s.bind(('localhost', 19999)) >>> s.listen(2) >>> a1 = socket.socket() >>> a2 = socket.socket() >>> a1.connect(('localhost', 19999)) >>> a2.connect(('localhost', 19999)) >>> b1 = s.accept() >>> b2 = s.accept() >>> b1[0].getsockname() ('127.0.0.1', 19999) >>> b2[0].getsockname() ('127.0.0.1', 19999) >>> That is, it's normal for the `r` in > r, addr = a.accept() to repeat port numbers across multiple `accept()` calls, and indeed to duplicate the port number from the `bind` call. This always confused me (from way back in my Unix days -- it's not "a Windows thing"), and maybe it's not what you're talking about anyway. > If I remove a.close(), and keep a around (by passing it to the caller), a.bind > works as expected - it raises socket.error: (10048, 'Address already in use'). As above, I'm seeing `bind` raise exceptions regardless. > But in the litterature on sockets, I read it should be okay to close the server > socket and keep using the client sockets. > > So, is this a possible bug in bind() ? Sure feels that way to me, and I'm not seeing it (or don't know how to provoke it). But I'm not a socket expert, and am not sure I've ever met anyone who truly was ;-) > I have tested the new code from Tim Peters, it apparently works, ports are given > out by windows. > But could the same problem with bind occur here, since a is closed (and garbage > collected) ? (far less chance for that since we do not specify port numbers, I > know). > > I tried getting a pair of sockets with Tim's code, and then trying to bind a > third socket to the same port as a/r. And I got the same problem as above. Here I'm not sure what "the same problem" means, as you've described more than one problem. Do you mean that you get a hang? Or that you see suspiciously repeated port numbers? Or ...? Seeing concrete code might help. Last question for now: have you seen a hang on more than one flavor of Windows? Thanks for digging into this! [and Sune's code] > import socket, errno > > class BindError(Exception): > pass > > > def socktest(): > """blabla > """ > > address = ('127.9.9.9', 19999) > > a = socket.socket (socket.AF_INET, socket.SOCK_STREAM) > w = socket.socket (socket.AF_INET, socket.SOCK_STREAM) > > # set TCP_NODELAY to true to avoid buffering > w.setsockopt(socket.IPPROTO_TCP, 1, 1) > > # tricky: get a pair of connected sockets > host='127.0.0.1' > port=19999 > > while 1: > print port > try: > a.bind((host, port)) > break > except: > if port <= 19950: > raise BindError, 'Cannot bind trigger!' > port=port - 1 > > a.listen (1) > w.setblocking (0) > try: > w.connect ((host, port)) > except: > pass > r, addr = a.accept() > a.close() > w.setblocking (1) > > #return (a, w, r) > return (w, r) > #return w

2 20

Using relative paths doesn't seem to work as i thought
by tomatbiz-tominfo＠yahoo.co.uk 01 Aug '05

01 Aug '05

Using relative paths doesn't seem to work as i thought. For example : I have a Plone site "Plone" Under that i have a folder object named "Sales" In Sales i have a Page Template object named "SalesPage". I also put an "index_html" file object inside Sales Folder. I thought that the href inside index_html linking to SalesPage to the same folder would be "./SalesPage". This works fine from inside the ZMI witch gives me "http://localhost:8080/Plone/Sales/SalesPage". The problem is when i try to see the page from outside ZMI witch gives me "http://localhost/SalesPage". So i had to change the href to "./Sales/SalesPage" This one gives "http://localhost:8080/Plone/Sales/Sales/SalesPage" inside ZMI and "http://localhost/Plone/Sales/SalesPage" outside the ZMI. The funny thing is that they both work and give the page i wantto see but i thing "http://localhost:8080/Plone/Sales/Sales/SalesPage" sould not work since i do not have any "/Plone/Sales/Sales" Folder object. I use Zope 2.7.0 on Windows XP Pro and i have installed Hotfix_20040714 Could anyone help me on this? How sould i reffer to current folder instead of "." from an html inside this folder? Thanks in advance. ___________________________________________________________ Χρησιμοποιείτε Yahoo!; Βαρεθήκατε τα ενοχλητικά μηνύματα (spam); Το Yahoo! Mail διαθέτει την καλύτερη δυνατή προστασία κατά των ενοχλητικών μηνυμάτων http://login.yahoo.com/config/mail?.intl=gr

2 2

Oracle 9.2.0.2
by Robert 01 Aug '05

01 Aug '05

Can Zope use it for its database? And if so what do I use? Robert

5 5

RE: [Zope] Updating BLOB fields in Interbase database
by bobb 01 Aug '05

01 Aug '05

I posted some stuff I was doing some time ago w/ mysql / blobs and zope some time ago so that my grandchildren could google for it :)... if you goggle for zope mysql blob bobb you'll get it. It's not interbase. hth bobb Also, your post came through as a newsgroup posting, which means I had to cut / paste / finagle the whole thing to reply... It's the first time I've ever seen that (I use m$ outlook express) How are you posting to here? (curious, that's all) "Ashley" <ashleylloyd(a)hotmail.com> wrote in message news:dcd0n1$ida$1@sea.gmane.org... > I'm not sure if this is the right place for this, if not, my apologies. > > I've got a Clients table in an interbase db with various fields, one of > which is a BLOB field (subtype text), used to maintain some notes. > > When inserting a Client into the table, this field populates fine. > > However, when attempting to update the client, for some reason, it won't. It > just will not allow me to do an update with the notes field in the > statement. I've googled around, and found lots of bits helping with Delphi, > and lots of statements that BLOB fields in Interbase are tricky to update, > but nothing that helps. > > Has anyone out there found a way around this? > > I'm using currently using gvib as my database adaptor, as kinterbase does > not seem to want to install at all (seemingly problems with ldap ..). > > My Zope instance is installed from a Plone installer. > Zope Version (Zope 2.6.1 (binary release, python 2.1, win32-x86), > python 2.1.3, win32) > Python Version 2.1.3 (#35, Apr 8 2002, 17:47:50) [MSC 32 bit (Intel)] > System Platform win32 > > > Thanks in advance > Ashley > > > > _______________________________________________ > Zope maillist - Zope(a)zope.org > http://mail.zope.org/mailman/listinfo/zope > ** No cross posts or HTML encoding! ** > (Related lists - > http://mail.zope.org/mailman/listinfo/zope-announce > http://mail.zope.org/mailman/listinfo/zope-dev )

2 1

Storing Local Roles Externally
by Michael Carter 01 Aug '05

01 Aug '05

Hello, I can't find an appropriate list for this, but this one seems the best fit. I have a need to obtain local roles for my folder-like product from an sql database. How do I redefine the functions that handle local roles? I don't know what their names are. -Michael

2 1

Re: [Zope] Zsyncer issue
by Matt Howell 31 Jul '05

31 Jul '05

(Sorry about the cross post! I did not pay attention to what I was typing in the address, but perhaps this is the best place for this question anyway.) > to achieve what end? One of my projects has a requirement for providing 99.99% uptime when hosting in their data center. Our Zope / Plone solution will be replacing an ASP / SQL Server solution that has 2x web servers and 2x SQL Servers (using log shipping). Tentatively, my hosting recommendation resembles two web servers, running Apache / FastCGI / Zope, and then two servers running ZEO / ZODB and ExFile. My current thoughts would be to commission SAN space between the two ZEO servers so that the Data.fs, etc. would be shared between the two database servers. SAN space is expensive, though, so when I saw a posting about Zsyncer, I was wondering if there might be a solution for keeping two instances of a ZODB synced up. We already have two Cisco CSS to handle heart beats and failover. Thanks for the responses... -Matt

2 1

[Plone-users] Zsyncer issue
by Matt Howell 31 Jul '05

31 Jul '05

I have not used Zsyncer before, so please excuse me if this question is remedial. Would Zsyncer be a good solution for making a ZEO-based ZODB highly available? If not, what are other people doing for larger Plone / Zope deployments? -Matt

2 1

inspect and page templates in python product
by Peter Bengtsson 31 Jul '05

31 Jul '05

I'm using the inspect module in my python product to step back when doing some debugging. My code looks something like this:: class MyProduct: def hasRole(self, r): for i in range(25): try: print inspect.stack()[i][3], print inspect.stack()[i][2], except IndexError: break It works wonderfully well except when the caller of hasRole() is a Page Template defined with the PageTemplateFile function. (it might be equally bad with a ZODB persistent template I think). Does anybody know if and how if there is a way to step back and found out which template called hasRole() [ and maybe even which line] ? If I do this debugging now, it gives me something like: (hasRole:326, <expression>:1, __call__:47, evaluate:221, do_condition:636, interpret:234, do_defineSlot:694, interpret:234, no_tag:389, do_optTag:394, do_optTag_tal:409, interpret:234, do_useMacro:671, interpret:234, __call__:190, pt_render:96, _exec:106, _exec:343, _bindAndExec:343, __call__:306) -- Peter Bengtsson, work www.fry-it.com home www.peterbe.com hobby www.issuetrackerproduct.com

2 1

Re: [Zope] What "Maximum age of a cache entry (seconds)" means in RAM Cache Manager?
by J Cameron Cooper 30 Jul '05

30 Jul '05

Litao Wei wrote: > I have read the zope book and zope online help about RAM Cache > Manager. But all of them didn't say anything about the parameter "What > "Maximum age of a cache entry (seconds)" mean. > It looks that this parameter like "Cleanup interval (seconds)", which > zope book explained as "The lifetime of cached results.". But what > this parameter mean? Would somebody give me an explaination? It means exactly as it seems to mean. Maximum age: No cache entry older than n seconds, where n is the value you supply for that setting, will be used. Cleanup interval: Appx every n seconds, sweep the cache and remove entries that are expired, as in the above parameter. You would not want to do this too often (for performance reasons) nor too little (lest the cache become very large). --jcc -- Building Websites with Plone http://plonebook.packtpub.com/

1 0

Zope 3 Bug Day Summary
by Stephan Richter 30 Jul '05

30 Jul '05

Hello everyone! I just wanted to let everyone know that we had a very successfull Zope 3 Bug Day today! I would like to thank Zope Corporation, POV, Nuxeo and the other community members for supporting this event by providing the manpower we needed! We were able to fix all outstanding bugs that prohibited us from making the first release candidate of Zope 3.1. As a result, I will create the 3.1 branch today, lift the feature freeze, and make a release later this weekend or first thing on Monday. Here is a list of participants and their contributions: - Gary Poster (Gary Poster): Fixed 397. Postponed 372. Removed XXX's. - Benji York (benji_work): Postponed 296, 316. Removed XXX's. Fixed 411. - Jim Fulton (J1m): Closed 344. Fixed 384. - Marius Gedminas (mgedmin): Removed duplicate tests. Fixed up forms. Fixed 302! Closed 327. - Albertas Agejevas (alga): Closed 336. Fixed 381. - Julien Anguenot (anguenot): Fixed 307. (Julien also fixed many bugs in recent weeks.) - Garrett Smith (garrett-smith): BBB code removal. Fixed 414. - Stephan Richter (srichter): Closed 302, 413, 415, 416, 419, 421. Additionally I want to thank Dmitry Vasiliev (hdima) who was not able to attend today, but was the most active community members in the last weeks to fix bugs and ensure the full internationalization of Zope 3. Thanks again to everyone for participating! Regards, Stephan -- Stephan Richter CBU Physics & Chemistry (B.S.) / Tufts Physics (Ph.D. student) Web2k - Web Software Design, Development and Training

2 1