March 2001 - Zope - Zope lists

They mysteries of logging in zope.
by John Morton 08 Mar '01

08 Mar '01

In the process of building a new login method for the Login Manager product, I thought it would be a good idea to have the beast log various indications of state out to syslog for later examination. ZLogger's interface is nice and easy and it looked like all I had to do to get logging to go to syslog was to set an environment variable. Unfortunately it just doesn't work that easily. Setting ZSYSLOG to log via /dev/log causes zope to crash straight away, setting ZSYSLOG_SERVER causes it to crash after between 10 seconds and a minute, and setting STUPID_FILE_LOGGER does nothing at all. Wading into the code I discovered a few things, and made some other observations: 1. There are no less than three separate logging systems used in Zope - logging via ZServer, logging via ZLogger and some form of debug logging via DebugLogger. They all seem to have different APIs. 2. ZServer and ZLogger both use a copy each of Sam Rushing's syslog module, but while ZLogger calls it properly, ZServer simply isn't. It doesn't appear to pass it a port at all. 3. Further up the line, the code that creates the logging object seems to pass ZSYSLOG straight through as a server address. I expect that a pair of patches to ZServer and z2.py will be able to fix the problem, but I'm interested if anyone has found any other solutions. John

1 1

LoginManager, SQL, and PythonScripts - Can't we all just get along?
by Steve Drees 08 Mar '01

08 Mar '01

Has anybody successfully deployed a GenericUserSource LoginManager that stores user info in an SQL database using PythonScripts for userAuthenticate, userExists, and userRoles?

1 0

RE: ZODBC problem (and ZmxODBC)
by Bryan Baszczewski 08 Mar '01

08 Mar '01

Alan, Yes, I moved the mx folder and I got it to work today too and will put it through some excrutiatingly painful tests tomorrow. But so far, so good. ...I'll let you know how it goes. Keep me posted on your success. -----Original Message----- From: Capesius, Alan [mailto:CapesiusA@Sysmex.com] Sent: Wednesday, March 07, 2001 6:49 PM To: bryanbz(a)2s2i.com Cc: zope(a)zope.org Subject: RE: ZODBC problem (and ZmxODBC) Excellent. The ZmxODBC driver has resolved the problem for me. Performance is now unaffected by the slow queries. I'm using Access and SQL7 dbs, not sure if Access ODBC is multi-threaded, so I may need to run a mix of drivers, but the test server hasn't crashed yet. A note on the ZmxODBC install, the docs indicate that you should copy the mx folder to the Shared folder. This will not work (and is the default). The coding requires that you move the mx folder up one level after extraction it into the Zope tree. It should be at ZopePath\lib\python\mx Thanks Bryan, Alan >>>-----Original Message----- >>>From: Bryan Baszczewski [mailto:bryanbz@2s2i.com] >>>Sent: Wednesday, March 07, 2001 1:08 PM >>>To: 'Capesius, Alan'; zope(a)zope.org >>>Cc: zope-dev(a)zope.org >>>Subject: RE: [Zope-dev] RE: ZODBC problem >>> >>> >>>Alan, I am having a similar lock-out problem while >>>performing a complex >>>query on SQL Server 2K. All other hits cannot connect until >>>the query >>>returns the results. My research has so far taken me here: >>> >>>http://www.zope.org/Members/petrilli/DARoadmap >>>Which is telling me I am probably using at most a Level-2 DA >>>with my ZODBC. >>> >>>And then here: >>> >>>http://www.zope.org/Members/djay/ZmxODBC/ZmxODBC_0_0_2.tgz/README >>>Which is a Level-3 mxZODBC DA (multithreaded). >>> >>>If anyone sees a problem with what I am about to do, let me >>>know. What do >>>you think? >>> >>> >>> >>>-----Original Message----- >>>From: zope-dev-admin(a)zope.org >>>[mailto:zope-dev-admin@zope.org]On Behalf >>>Of Capesius, Alan >>>Sent: Wednesday, March 07, 2001 12:31 PM >>>To: zope(a)zope.org >>>Cc: zope-dev(a)zope.org >>>Subject: [Zope-dev] RE: ZODBC problem >>> >>> >>>Thanks Dieter, I was kinda looking for a solution, I >>>reviewed the mailing >>>lists but do not see any solutions. I've done some more testing here: >>> >>>Summary: The user selects an involved financial report. The >>>report takes >>>about 55 seconds for Zope to prepare. The first second is >>>the SQL server >>>request and reply. The remaining time is Zope processing >>>(dual 200mhz NT >>>box). >>> >>>My queries are SELECT JOINS. No tables are modified at the server. >>> >>>The problem I see here is that Zope/ZODBCDA is holding the >>>connection to SQL >>>open via ODBC until all processing is complete and then >>>issuing an SQL >>>statement: IF @@TRANCOUNT>0 COMMIT TRAN >>> >>>Zope could free up this connection after one second. (at >>>least in this case) >>>Until Zope does the commit, other users are locked out. >>> >>>For read only queries, there is no need to have the request under >>>transaction control. In any case, Zope should be able to >>>early release the >>>SQL connection and then process on the results. >>> >>>Certainly increasing processor speed will mask this problem >>>and provide >>>better response to users, but I'm hoping for a real fix. >>> >>>Thanks, >>>Alan >>> >>>Network Monitor trace Wed 03/07/01 10:51:50 c:\cap1.TXT >>> >>>Frame Time Src MAC Addr Dst MAC Addr Protocol >>>1 4.413 006008F6062B COMPAQ851F04 TCP >>>2 4.413 006008F6062B COMPAQ851F04 TCP >>>3 4.413 006008F6062B COMPAQ851F04 TCP >>>[....] >>>193 5.072 006008F6062B COMPAQ851F04 TCP >>>194 5.073 COMPAQ851F04 006008F6062B TCP >>>195 5.090 COMPAQ851F04 006008F6062B TCP >>>196 5.090 006008F6062B COMPAQ851F04 TCP >>>197 5.090 006008F6062B COMPAQ851F04 TCP >>>198 5.091 COMPAQ851F04 006008F6062B TCP >>>199 5.109 COMPAQ851F04 006008F6062B TCP >>>200 5.127 COMPAQ851F04 006008F6062B TCP // SQL >>>server goes idle >>>after this >>> >>>// python DTML processing occurs here >>> >>> >>>201 10.834 006008F6062B COMPAQ851F04 TCP // not >>>sure what this is, >>>Data is 0xA8 >>>202 10.834 COMPAQ851F04 006008F6062B TCP // reply, >>>data is empty >>> >>>// page returns to user at 60 second mark >>>// then Zope closes the connection >>>203 60.385 COMPAQ851F04 006008F6062B TCP >>> SQL: IF @@TRANCOUNT>0 COMMIT TRAN >>>204 60.386 006008F6062B COMPAQ851F04 TCP >>>205 60.601 COMPAQ851F04 006008F6062B TCP >>> >>> >>>>Capesius, Alan writes: >>>> > ... >>>> > with further testing I >>>> > have determined that the Zope server itself is not >>>locking up, but >>>rather >>>> > requests to the database (MS SQL7 via ZODBCDA) seem to >>>be queueing up. >>> >>>>My memory tells me faintly that such an issue has already been >>>>discussed in the mailing lists (zope, zope-dev). >>>>When I remember right, ZODBCDA synchronizes all database requests >>>>--> searchable list archives... >>> >>> >>>>Dieter >>> >>>_______________________________________________ >>>Zope-Dev maillist - Zope-Dev(a)zope.org >>>http://lists.zope.org/mailman/listinfo/zope-dev >>>** No cross posts or HTML encoding! ** >>>(Related lists - >>> http://lists.zope.org/mailman/listinfo/zope-announce >>> http://lists.zope.org/mailman/listinfo/zope ) >>>

1 0

Re: [Zope] Make a Zope object single threaded
by Dieter Maurer 08 Mar '01

08 Mar '01

Tim Lakey writes: > Does anyone know how to force a Zope product to be single threaded within > Zope? I cannot tell you, how you can make a single product single threaded, but URL:http://www.dieter.handshake.de/pyprojects/zope/SharedResource.html will show you, how you can synchronize access to a resource using locks. Dieter

2 1

Re: [Zope] Method invocation.
by Dieter Maurer 08 Mar '01

08 Mar '01

Antonio Costa writes: > This is a multi-part message in MIME format. > --------------0FCBD795A66219CE28E5CE35 > Content-Type: text/plain; charset=us-ascii > Content-Transfer-Encoding: 7bit Please, do not post MIME messages! > .... > File SearchObject.py: > > manage_addSearchObjectForm = DTMLFile('dtml/searchObjectManage', > globals()) > > def manage_prevAddSearchObject(self): > "Criacao de um objecto SearchObject" > > # print 'Ola' + str(self) > # global manage_addSearchObjectForm ##### Desperate attempt ##### > # import SearchObject ##### Another one ##### > return manage_addSearchObjectForm() ##### Error in this line. > .... > Error Type: AttributeError > Error Value: aq_parent You strip the context from "manage_addSearchObjectForm". Try: return manage_addSearchObjectForm(self) Dieter

5 6

How to add new properties to default image objects?
by Ausum 07 Mar '01

07 Mar '01

I'd like that all the image objects of my site have more information default fields such as "summary", "keywords", "author", "links", etc, more like an album, and I'm looking forward to modify the Image.py file and its related dtmls. Can anyone explain me what kind of modifications are needed? I know there are photoalbum products out there, but guess I'm just needing the default properties to increase in a few fields. (The fact is that from time to time I need to import a large number of images, and I use ftp for the task. If the default image object already had the mentioned fields, it would be an easier task to just add content to it.) Thanks in advance, Ausum

1 0

RE: ZODBC problem (and ZmxODBC)
by Capesius, Alan 07 Mar '01

07 Mar '01

Excellent. The ZmxODBC driver has resolved the problem for me. Performance is now unaffected by the slow queries. I'm using Access and SQL7 dbs, not sure if Access ODBC is multi-threaded, so I may need to run a mix of drivers, but the test server hasn't crashed yet. A note on the ZmxODBC install, the docs indicate that you should copy the mx folder to the Shared folder. This will not work (and is the default). The coding requires that you move the mx folder up one level after extraction it into the Zope tree. It should be at ZopePath\lib\python\mx Thanks Bryan, Alan >>>-----Original Message----- >>>From: Bryan Baszczewski [mailto:bryanbz@2s2i.com] >>>Sent: Wednesday, March 07, 2001 1:08 PM >>>To: 'Capesius, Alan'; zope(a)zope.org >>>Cc: zope-dev(a)zope.org >>>Subject: RE: [Zope-dev] RE: ZODBC problem >>> >>> >>>Alan, I am having a similar lock-out problem while >>>performing a complex >>>query on SQL Server 2K. All other hits cannot connect until >>>the query >>>returns the results. My research has so far taken me here: >>> >>>http://www.zope.org/Members/petrilli/DARoadmap >>>Which is telling me I am probably using at most a Level-2 DA >>>with my ZODBC. >>> >>>And then here: >>> >>>http://www.zope.org/Members/djay/ZmxODBC/ZmxODBC_0_0_2.tgz/README >>>Which is a Level-3 mxZODBC DA (multithreaded). >>> >>>If anyone sees a problem with what I am about to do, let me >>>know. What do >>>you think? >>> >>> >>> >>>-----Original Message----- >>>From: zope-dev-admin(a)zope.org >>>[mailto:zope-dev-admin@zope.org]On Behalf >>>Of Capesius, Alan >>>Sent: Wednesday, March 07, 2001 12:31 PM >>>To: zope(a)zope.org >>>Cc: zope-dev(a)zope.org >>>Subject: [Zope-dev] RE: ZODBC problem >>> >>> >>>Thanks Dieter, I was kinda looking for a solution, I >>>reviewed the mailing >>>lists but do not see any solutions. I've done some more testing here: >>> >>>Summary: The user selects an involved financial report. The >>>report takes >>>about 55 seconds for Zope to prepare. The first second is >>>the SQL server >>>request and reply. The remaining time is Zope processing >>>(dual 200mhz NT >>>box). >>> >>>My queries are SELECT JOINS. No tables are modified at the server. >>> >>>The problem I see here is that Zope/ZODBCDA is holding the >>>connection to SQL >>>open via ODBC until all processing is complete and then >>>issuing an SQL >>>statement: IF @@TRANCOUNT>0 COMMIT TRAN >>> >>>Zope could free up this connection after one second. (at >>>least in this case) >>>Until Zope does the commit, other users are locked out. >>> >>>For read only queries, there is no need to have the request under >>>transaction control. In any case, Zope should be able to >>>early release the >>>SQL connection and then process on the results. >>> >>>Certainly increasing processor speed will mask this problem >>>and provide >>>better response to users, but I'm hoping for a real fix. >>> >>>Thanks, >>>Alan >>> >>>Network Monitor trace Wed 03/07/01 10:51:50 c:\cap1.TXT >>> >>>Frame Time Src MAC Addr Dst MAC Addr Protocol >>>1 4.413 006008F6062B COMPAQ851F04 TCP >>>2 4.413 006008F6062B COMPAQ851F04 TCP >>>3 4.413 006008F6062B COMPAQ851F04 TCP >>>[....] >>>193 5.072 006008F6062B COMPAQ851F04 TCP >>>194 5.073 COMPAQ851F04 006008F6062B TCP >>>195 5.090 COMPAQ851F04 006008F6062B TCP >>>196 5.090 006008F6062B COMPAQ851F04 TCP >>>197 5.090 006008F6062B COMPAQ851F04 TCP >>>198 5.091 COMPAQ851F04 006008F6062B TCP >>>199 5.109 COMPAQ851F04 006008F6062B TCP >>>200 5.127 COMPAQ851F04 006008F6062B TCP // SQL >>>server goes idle >>>after this >>> >>>// python DTML processing occurs here >>> >>> >>>201 10.834 006008F6062B COMPAQ851F04 TCP // not >>>sure what this is, >>>Data is 0xA8 >>>202 10.834 COMPAQ851F04 006008F6062B TCP // reply, >>>data is empty >>> >>>// page returns to user at 60 second mark >>>// then Zope closes the connection >>>203 60.385 COMPAQ851F04 006008F6062B TCP >>> SQL: IF @@TRANCOUNT>0 COMMIT TRAN >>>204 60.386 006008F6062B COMPAQ851F04 TCP >>>205 60.601 COMPAQ851F04 006008F6062B TCP >>> >>> >>>>Capesius, Alan writes: >>>> > ... >>>> > with further testing I >>>> > have determined that the Zope server itself is not >>>locking up, but >>>rather >>>> > requests to the database (MS SQL7 via ZODBCDA) seem to >>>be queueing up. >>> >>>>My memory tells me faintly that such an issue has already been >>>>discussed in the mailing lists (zope, zope-dev). >>>>When I remember right, ZODBCDA synchronizes all database requests >>>>--> searchable list archives... >>> >>> >>>>Dieter >>> >>>_______________________________________________ >>>Zope-Dev maillist - Zope-Dev(a)zope.org >>>http://lists.zope.org/mailman/listinfo/zope-dev >>>** No cross posts or HTML encoding! ** >>>(Related lists - >>> http://lists.zope.org/mailman/listinfo/zope-announce >>> http://lists.zope.org/mailman/listinfo/zope ) >>>

1 0

Methods to connect Linux Zope to ODBC database
by Chris Beaumont 07 Mar '01

07 Mar '01

Hello, I'm looking for a way to enable our (Debian) Linux-based Zope installation to connect for some very simple (read-only) interaction with a FileMaker Pro database that is available via ODBC. I'm wondering what others have used to do something like this. I realize that there are commercial 'bridge' products out there that will make the connection, but as far as I can see, there isnt an ODBC DA for Linux. Is there any workaround? Or does anyone have any suggestions, or experience with any method that they would be willing to share? Thanks. Chris Beaumont cbeaumon(a)msri.org

2 1

Re: [Zope] Subtracting PreciseTime
by Dieter Maurer 07 Mar '01

07 Mar '01

Paul Zwarts writes: > I have two dates that I want to find the difference in minutes or hours > (preferably minutes) > > zdate 2001/03/07 17:08:00 GMT+1 > start_date 2001/03/07 16:41:14 GMT+1 > > What I try: > > <dtml-var expr="_.DateTime(zdate-start_date).PreciseTime()"> Please read the "DateTime" documentation carefully. I expect, both "zdate" and "start_date" are DateTime objects. Then, "zdate-start_date" is a floating point number representing the difference in days! The "DateTime" constructor interprets a float as a number of seconds since the epoch which is apparently "1970/01/01 01:00:00". Thus, the construct above will not give you what you want. Try: <dtml-var expr="(zdate-start_date)*24*60"> Dieter

1 0

Re: [Zope] Creating a directory using Zcatalog and either tree or some other method
by Dieter Maurer 07 Mar '01

07 Mar '01

Chris Muldrow writes: > I've got news stories in a Zcatalog. I want to build a directory of said > stories.... > I want to > display them under headers using the following criteria: If > Category=='Local', then print a header for the localities and sort them. > Otherwise, print a header for the categories. Here's how it should look: I am sure, I do not understand precisely what you want. But, you may look at "dtml-in"'s grouping support ("sequence-first-XXX", "sequence-last-XXX") after you sorted your stories appropriately. More details in URL:http://www.dieter.handshake.de/pyprojects/zope/book/chap3.html Dieter

1 0