March 2001 - Zope - Zope lists

RE: [Zope] RE: ZODBC problem (and ZmxODBC)
by Capesius, Alan 08 Mar '01

08 Mar '01

>From the Docs for ZmxODBCDA: Added experimental support for Unicode. This needs Python 2.0 (it should work with Python 1.6 too). To enable the Unicode support, compile the subpackages with -DWANT_UNICODE_SUPPORT. I don't have time to look into the 2.0 conversion and recompile of ZmxODBC so I'll live with the thing the way it is. My queries are all functioning at this point. >>>-----Original Message----- >>>From: Jzlio Dinis Silva [mailto:juliodinis@hotmail.com] >>>Sent: Thursday, March 08, 2001 5:03 PM >>>To: CapesiusA(a)Sysmex.com >>>Cc: zope(a)zope.org >>>Subject: RE: [Zope] RE: ZODBC problem (and ZmxODBC) >>> >>> >>>Hi, >>> >>>And there is also a Internal Error that happen when I do a >>>select to tables with a text datatype. Wether the text datatype >>>or maybe some internacional chars I have in this text fields, one >>>of this are also not supported by zmxodb. >>> >>>cia, >>>Julio Dinis Silva >>> >>> >>>>From: "Capesius, Alan" <CapesiusA(a)Sysmex.com> >>>>To: Jzlio Dinis Silva <juliodinis(a)hotmail.com> >>>>CC: zope(a)zope.org, mal(a)lemburg.com >>>>Subject: RE: [Zope] RE: ZODBC problem (and ZmxODBC) >>>>Date: Thu, 8 Mar 2001 15:35:59 -0600 >>>> >>>>OOPS. >>>> >>>>I do get the error. I apologize, I was looking at the wrong >>>ODBC_ link. >>>>ZmxODBC browser is failing as well for me. >>>> >>>>The problem is that ZmxODBC does not support the nvarchar data type >>>>(unicode >>>>varchar) in use in the Information_schema.columns table. >>>This could render >>>>ZmxODBCDA useless under certain conditions. >>>> >>>> >>>> >>>>An interesting aside: >>>>I use three queries to pull browse info from the tables >>>list. This is much >>>>faster than using the browser feature. Set the data source >>>to your ODBC >>>>source. >>>> >>>> >>>>Query 1 A_Table_Scan(search for all fieldnames containing >>>searchstring >>>> %__% wildcards OK): >>>>============================================================ >>>========== >>>>Arguments: search_sting >>>>SQL String: >>>>SELECT table_catalog,table_name,column_name,data_type FROM >>>>INFORMATION_SCHEMA.COLUMNS >>>>where column_name like <dtml-sqlvar search_string type=string> >>>>order by ordinal_position >>>> >>>>Query 2 A_Table_Structure (Show structure of selected table): >>>>============================================================ >>>========== >>>>Arguments: table >>>>SQL String: >>>>SELECT table_catalog,table_name,column_name,data_type FROM >>>>INFORMATION_SCHEMA.COLUMNS >>>>where table_name = <dtml-sqlvar table type=nb> >>>>order by ordinal_position >>>> >>>>Query 3 A_Tables (List tables): >>>>============================================================ >>>========== >>>>Arguments: NONE >>>>SQL String: >>>>SELECT * FROM INFORMATION_SCHEMA.TABLES >>>> >>>> >>>> >>>> >>>-----Original Message----- >>>> >>>From: Jzlio Dinis Silva [mailto:juliodinis@hotmail.com] >>>> >>>Sent: Thursday, March 08, 2001 2:46 PM >>>> >>>To: CapesiusA(a)Sysmex.com >>>> >>>Cc: zope(a)zope.org >>>> >>>Subject: RE: [Zope] RE: ZODBC problem (and ZmxODBC) >>>> >>> >>>> >>> >>>> >>>Hi >>>> >>> >>>> >>>I have the same versions but I still get the InterfaceError. >>>> >>> >>>> >>>I am able to create a table, insert some records and >>>> >>>query the table, but commands like sp_who or sp_tables, or >>>> >>>if I try to >>>> >>>view the "browse" tab I get an InterfaceError. >>>> >>> >>>> >>>Please confirm if the only changes you made was related >>>to moving >>>> >>>the mx directory to lib/python, and the rest was just like the >>>> >>>installations instructions said. >>>> >>> >>>> >>>Do you have the sqlserver7 on the same machine you have zope? >>>> >>> >>>> >>>Thanx, >>>> >>>Julio Dinis Silva >>>> >>> >>>> >>> >>>> >>>>From: "Capesius, Alan" <CapesiusA(a)Sysmex.com> >>>> >>>>To: Jzlio Dinis Silva <juliodinis(a)hotmail.com> >>>> >>>>Subject: RE: [Zope] RE: ZODBC problem (and ZmxODBC) >>>> >>>>Date: Thu, 8 Mar 2001 09:26:58 -0600 >>>> >>>> >>>> >>>>No problems with the browse tab here. >>>> >>>>I am running MDAC 2.5 drivers. >>>> >>>>Thats 3.70.08.20 for SQL Server. >>>> >>>>SQL is SQL7 SP2 >>>> >>>>And the ZmxODBC is 0.0.2 release. >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>-----Original Message----- >>>> >>>> >>>From: Jzlio Dinis Silva [mailto:juliodinis@hotmail.com] >>>> >>>> >>>Sent: Thursday, March 08, 2001 6:16 AM >>>> >>>> >>>To: CapesiusA(a)Sysmex.com >>>> >>>> >>>Cc: zope(a)zope.org >>>> >>>> >>>Subject: Re: [Zope] RE: ZODBC problem (and ZmxODBC) >>>> >>>> >>> >>>> >>>> >>> >>>> >>>> >>>Hi, >>>> >>>> >>> >>>> >>>> >>>I had some problems in the past using zmxodbcda and sql7. >>>> >>>> >>> >>>> >>>> >>>What version of sqlserver drivers are you using? >>>> >>>> >>> >>>> >>>> >>>If you click on the tab "browse" of your zmxodbda >>>connection >>>> >>>> >>>do you get a >>>> >>>> >>>InterfaceError? >>>> >>>> >>> >>>> >>>> >>>thanx, >>>> >>>> >>>Julio Dinis Silva >>>> >>>> >>> >>>> >>>> >>> >>>> >>>> >>>>From: "Capesius, Alan" <CapesiusA(a)Sysmex.com> >>>> >>>> >>>>To: bryanbz(a)2s2i.com >>>> >>>> >>>>CC: zope(a)zope.org >>>> >>>> >>>>Subject: [Zope] RE: ZODBC problem (and ZmxODBC) >>>> >>>> >>>>Date: Wed, 7 Mar 2001 17:49:09 -0600 >>>> >>>> >>>> >>>> >>>> >>>>Excellent. The ZmxODBC driver has resolved the >>>problem for me. >>>> >>>> >>>>Performance is now unaffected by the slow queries. >>>> >>>> >>>> >>>> >>>> >>>>I'm using Access and SQL7 dbs, not sure if Access ODBC is >>>> >>>> >>>multi-threaded, >>>> >>>> >>>>so >>>> >>>> >>>>I may need to run a mix of drivers, but the test server >>>> >>>> >>>hasn't crashed yet. >>>> >>>> >>>> >>>> >>>> >>>>A note on the ZmxODBC install, the docs indicate that you >>>> >>>> >>>should copy the >>>> >>>> >>>>mx >>>> >>>> >>>>folder to the Shared folder. This will not work >>>(and is the >>>> >>>> >>>default). The >>>> >>>> >>>>coding requires that you move the mx folder up one level >>>> >>>> >>>after extraction >>>> >>>> >>>>it >>>> >>>> >>>>into the Zope tree. It should be at ZopePath\lib\python\mx >>>> >>>> >>>> >>>> >>>> >>>>Thanks Bryan, >>>> >>>> >>>> >>>> >>>> >>>>Alan >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>-----Original Message----- >>>> >>>> >>>> >>>From: Bryan Baszczewski [mailto:bryanbz@2s2i.com] >>>> >>>> >>>> >>>Sent: Wednesday, March 07, 2001 1:08 PM >>>> >>>> >>>> >>>To: 'Capesius, Alan'; zope(a)zope.org >>>> >>>> >>>> >>>Cc: zope-dev(a)zope.org >>>> >>>> >>>> >>>Subject: RE: [Zope-dev] RE: ZODBC problem >>>> >>>> >>>> >>> >>>> >>>> >>>> >>> >>>> >>>> >>>> >>>Alan, I am having a similar lock-out problem while >>>> >>>> >>>> >>>performing a complex >>>> >>>> >>>> >>>query on SQL Server 2K. All other hits cannot >>>> >>>connect until >>>> >>>> >>>> >>>the query >>>> >>>> >>>> >>>returns the results. My research has so far >>>taken me here: >>>> >>>> >>>> >>> >>>> >>>> >>>> >>>http://www.zope.org/Members/petrilli/DARoadmap >>>> >>>> >>>> >>>Which is telling me I am probably using at most a >>>> >>>Level-2 DA >>>> >>>> >>>> >>>with my ZODBC. >>>> >>>> >>>> >>> >>>> >>>> >>>> >>>And then here: >>>> >>>> >>>> >>> >>>> >>>> >>>> >>>> >>>> >>>> >>>>>>>>>http://www.zope.org/Members/djay/ZmxODBC/ZmxODBC_0_0_2. >>>> >>>tgz/README >>>> >>>> >>>> >>>Which is a Level-3 mxZODBC DA (multithreaded). >>>> >>>> >>>> >>> >>>> >>>> >>>> >>>If anyone sees a problem with what I am about >>>to do, let me >>>> >>>> >>>> >>>know. What do >>>> >>>> >>>> >>>you think? >>>> >>>> >>>> >>> >>>> >>>> >>>> >>> >>>> >>>> >>>> >>> >>>> >>>> >>>> >>>-----Original Message----- >>>> >>>> >>>> >>>From: zope-dev-admin(a)zope.org >>>> >>>> >>>> >>>[mailto:zope-dev-admin@zope.org]On Behalf >>>> >>>> >>>> >>>Of Capesius, Alan >>>> >>>> >>>> >>>Sent: Wednesday, March 07, 2001 12:31 PM >>>> >>>> >>>> >>>To: zope(a)zope.org >>>> >>>> >>>> >>>Cc: zope-dev(a)zope.org >>>> >>>> >>>> >>>Subject: [Zope-dev] RE: ZODBC problem >>>> >>>> >>>> >>> >>>> >>>> >>>> >>> >>>> >>>> >>>> >>>Thanks Dieter, I was kinda looking for a solution, I >>>> >>>> >>>> >>>reviewed the mailing >>>> >>>> >>>> >>>lists but do not see any solutions. I've done >>>some more >>>> >>>> >>>testing here: >>>> >>>> >>>> >>> >>>> >>>> >>>> >>>Summary: The user selects an involved >>>financial report. The >>>> >>>> >>>> >>>report takes >>>> >>>> >>>> >>>about 55 seconds for Zope to prepare. The >>>first second is >>>> >>>> >>>> >>>the SQL server >>>> >>>> >>>> >>>request and reply. The remaining time is Zope >>>processing >>>> >>>> >>>> >>>(dual 200mhz NT >>>> >>>> >>>> >>>box). >>>> >>>> >>>> >>> >>>> >>>> >>>> >>>My queries are SELECT JOINS. No tables are modified at >>>> >>>> >>>the server. >>>> >>>> >>>> >>> >>>> >>>> >>>> >>>The problem I see here is that Zope/ZODBCDA >>>is holding the >>>> >>>> >>>> >>>connection to SQL >>>> >>>> >>>> >>>open via ODBC until all processing is >>>complete and then >>>> >>>> >>>> >>>issuing an SQL >>>> >>>> >>>> >>>statement: IF @@TRANCOUNT>0 COMMIT TRAN >>>> >>>> >>>> >>> >>>> >>>> >>>> >>>Zope could free up this connection after one >>>second. (at >>>> >>>> >>>> >>>least in this case) >>>> >>>> >>>> >>>Until Zope does the commit, other users are >>>locked out. >>>> >>>> >>>> >>> >>>> >>>> >>>> >>>For read only queries, there is no need to have the >>>> >>>> >>>request under >>>> >>>> >>>> >>>transaction control. In any case, Zope should >>>be able to >>>> >>>> >>>> >>>early release the >>>> >>>> >>>> >>>SQL connection and then process on the results. >>>> >>>> >>>> >>> >>>> >>>> >>>> >>>Certainly increasing processor speed will >>>mask this problem >>>> >>>> >>>> >>>and provide >>>> >>>> >>>> >>>better response to users, but I'm hoping for >>>a real fix. >>>> >>>> >>>> >>> >>>> >>>> >>>> >>>Thanks, >>>> >>>> >>>> >>>Alan >>>> >>>> >>>> >>> >>>> >>>> >>>> >>>Network Monitor trace Wed 03/07/01 10:51:50 >>>c:\cap1.TXT >>>> >>>> >>>> >>> >>>> >>>> >>>> >>>Frame Time Src MAC Addr Dst MAC Addr Protocol >>>> >>>> >>>> >>>1 4.413 006008F6062B COMPAQ851F04 TCP >>>> >>>> >>>> >>>2 4.413 006008F6062B COMPAQ851F04 TCP >>>> >>>> >>>> >>>3 4.413 006008F6062B COMPAQ851F04 TCP >>>> >>>> >>>> >>>[....] >>>> >>>> >>>> >>>193 5.072 006008F6062B COMPAQ851F04 TCP >>>> >>>> >>>> >>>194 5.073 COMPAQ851F04 006008F6062B TCP >>>> >>>> >>>> >>>195 5.090 COMPAQ851F04 006008F6062B TCP >>>> >>>> >>>> >>>196 5.090 006008F6062B COMPAQ851F04 TCP >>>> >>>> >>>> >>>197 5.090 006008F6062B COMPAQ851F04 TCP >>>> >>>> >>>> >>>198 5.091 COMPAQ851F04 006008F6062B TCP >>>> >>>> >>>> >>>199 5.109 COMPAQ851F04 006008F6062B TCP >>>> >>>> >>>> >>>200 5.127 COMPAQ851F04 006008F6062B >>>TCP // SQL >>>> >>>> >>>> >>>server goes idle >>>> >>>> >>>> >>>after this >>>> >>>> >>>> >>> >>>> >>>> >>>> >>>// python DTML processing occurs here >>>> >>>> >>>> >>> >>>> >>>> >>>> >>> >>>> >>>> >>>> >>>201 10.834 006008F6062B COMPAQ851F04 >>>TCP // not >>>> >>>> >>>> >>>sure what this is, >>>> >>>> >>>> >>>Data is 0xA8 >>>> >>>> >>>> >>>202 10.834 COMPAQ851F04 006008F6062B >>>TCP // reply, >>>> >>>> >>>> >>>data is empty >>>> >>>> >>>> >>> >>>> >>>> >>>> >>>// page returns to user at 60 second mark >>>> >>>> >>>> >>>// then Zope closes the connection >>>> >>>> >>>> >>>203 60.385 COMPAQ851F04 006008F6062B TCP >>>> >>>> >>>> >>> SQL: IF @@TRANCOUNT>0 COMMIT TRAN >>>> >>>> >>>> >>>204 60.386 006008F6062B COMPAQ851F04 TCP >>>> >>>> >>>> >>>205 60.601 COMPAQ851F04 006008F6062B TCP >>>> >>>> >>>> >>> >>>> >>>> >>>> >>> >>>> >>>> >>>> >>>>Capesius, Alan writes: >>>> >>>> >>>> >>>> > ... >>>> >>>> >>>> >>>> > with further testing I >>>> >>>> >>>> >>>> > have determined that the Zope server itself is not >>>> >>>> >>>> >>>locking up, but >>>> >>>> >>>> >>>rather >>>> >>>> >>>> >>>> > requests to the database (MS SQL7 via >>>ZODBCDA) seem to >>>> >>>> >>>> >>>be queueing up. >>>> >>>> >>>> >>> >>>> >>>> >>>> >>>>My memory tells me faintly that such an issue has >>>> >>>already been >>>> >>>> >>>> >>>>discussed in the mailing lists (zope, zope-dev). >>>> >>>> >>>> >>>>When I remember right, ZODBCDA synchronizes all >>>> >>>> >>>database requests >>>> >>>> >>>> >>>>--> searchable list archives... >>>> >>>> >>>> >>> >>>> >>>> >>>> >>> >>>> >>>> >>>> >>>>Dieter >>>> >>>> >>>> >>> >>>> >>>> >>>> >>>_______________________________________________ >>>> >>>> >>>> >>>Zope-Dev maillist - Zope-Dev(a)zope.org >>>> >>>> >>>> >>>http://lists.zope.org/mailman/listinfo/zope-dev >>>> >>>> >>>> >>>** No cross posts or HTML encoding! ** >>>> >>>> >>>> >>>(Related lists - >>>> >>>> >>>> >>> http://lists.zope.org/mailman/listinfo/zope-announce >>>> >>>> >>>> >>> http://lists.zope.org/mailman/listinfo/zope ) >>>> >>>> >>>> >>> >>>> >>>> >>>> >>>> >>>> >>>>_______________________________________________ >>>> >>>> >>>>Zope maillist - Zope(a)zope.org >>>> >>>> >>>>http://lists.zope.org/mailman/listinfo/zope >>>> >>>> >>>>** No cross posts or HTML encoding! ** >>>> >>>> >>>>(Related lists - >>>> >>>> >>>> http://lists.zope.org/mailman/listinfo/zope-announce >>>> >>>> >>>> http://lists.zope.org/mailman/listinfo/zope-dev ) >>>> >>>> >>> >>>> >>>> >>>>>>_____________________________________________________________ >>>> >>>> >>>____________ >>>> >>>> >>>Get Your Private, Free E-mail from MSN Hotmail at >>>> >>>>http://www.hotmail.com. >>>> >>> >>>> >>>_____________________________________________________________ >>>> >>>____________ >>>> >>>Get Your Private, Free E-mail from MSN Hotmail at >>>>http://www.hotmail.com. >>>> >>>>_______________________________________________ >>>>Zope maillist - Zope(a)zope.org >>>>http://lists.zope.org/mailman/listinfo/zope >>>>** No cross posts or HTML encoding! ** >>>>(Related lists - >>>> http://lists.zope.org/mailman/listinfo/zope-announce >>>> http://lists.zope.org/mailman/listinfo/zope-dev ) >>> >>>_____________________________________________________________ >>>____________ >>>Get Your Private, Free E-mail from MSN Hotmail at http://www.hotmail.com.

1 0

RE: [Zope] RE: ZODBC problem (and ZmxODBC)
by J�lio Dinis Silva 08 Mar '01

08 Mar '01

Hi, And there is also a Internal Error that happen when I do a select to tables with a text datatype. Wether the text datatype or maybe some internacional chars I have in this text fields, one of this are also not supported by zmxodb. cia, Julio Dinis Silva >From: "Capesius, Alan" <CapesiusA(a)Sysmex.com> >To: Jzlio Dinis Silva <juliodinis(a)hotmail.com> >CC: zope(a)zope.org, mal(a)lemburg.com >Subject: RE: [Zope] RE: ZODBC problem (and ZmxODBC) >Date: Thu, 8 Mar 2001 15:35:59 -0600 > >OOPS. > >I do get the error. I apologize, I was looking at the wrong ODBC_ link. >ZmxODBC browser is failing as well for me. > >The problem is that ZmxODBC does not support the nvarchar data type >(unicode >varchar) in use in the Information_schema.columns table. This could render >ZmxODBCDA useless under certain conditions. > > > >An interesting aside: >I use three queries to pull browse info from the tables list. This is much >faster than using the browser feature. Set the data source to your ODBC >source. > > >Query 1 A_Table_Scan(search for all fieldnames containing searchstring > %__% wildcards OK): >====================================================================== >Arguments: search_sting >SQL String: >SELECT table_catalog,table_name,column_name,data_type FROM >INFORMATION_SCHEMA.COLUMNS >where column_name like <dtml-sqlvar search_string type=string> >order by ordinal_position > >Query 2 A_Table_Structure (Show structure of selected table): >====================================================================== >Arguments: table >SQL String: >SELECT table_catalog,table_name,column_name,data_type FROM >INFORMATION_SCHEMA.COLUMNS >where table_name = <dtml-sqlvar table type=nb> >order by ordinal_position > >Query 3 A_Tables (List tables): >====================================================================== >Arguments: NONE >SQL String: >SELECT * FROM INFORMATION_SCHEMA.TABLES > > > > >>>-----Original Message----- > >>>From: Jzlio Dinis Silva [mailto:juliodinis@hotmail.com] > >>>Sent: Thursday, March 08, 2001 2:46 PM > >>>To: CapesiusA(a)Sysmex.com > >>>Cc: zope(a)zope.org > >>>Subject: RE: [Zope] RE: ZODBC problem (and ZmxODBC) > >>> > >>> > >>>Hi > >>> > >>>I have the same versions but I still get the InterfaceError. > >>> > >>>I am able to create a table, insert some records and > >>>query the table, but commands like sp_who or sp_tables, or > >>>if I try to > >>>view the "browse" tab I get an InterfaceError. > >>> > >>>Please confirm if the only changes you made was related to moving > >>>the mx directory to lib/python, and the rest was just like the > >>>installations instructions said. > >>> > >>>Do you have the sqlserver7 on the same machine you have zope? > >>> > >>>Thanx, > >>>Julio Dinis Silva > >>> > >>> > >>>>From: "Capesius, Alan" <CapesiusA(a)Sysmex.com> > >>>>To: Jzlio Dinis Silva <juliodinis(a)hotmail.com> > >>>>Subject: RE: [Zope] RE: ZODBC problem (and ZmxODBC) > >>>>Date: Thu, 8 Mar 2001 09:26:58 -0600 > >>>> > >>>>No problems with the browse tab here. > >>>>I am running MDAC 2.5 drivers. > >>>>Thats 3.70.08.20 for SQL Server. > >>>>SQL is SQL7 SP2 > >>>>And the ZmxODBC is 0.0.2 release. > >>>> > >>>> > >>>> > >>>> >>>-----Original Message----- > >>>> >>>From: Jzlio Dinis Silva [mailto:juliodinis@hotmail.com] > >>>> >>>Sent: Thursday, March 08, 2001 6:16 AM > >>>> >>>To: CapesiusA(a)Sysmex.com > >>>> >>>Cc: zope(a)zope.org > >>>> >>>Subject: Re: [Zope] RE: ZODBC problem (and ZmxODBC) > >>>> >>> > >>>> >>> > >>>> >>>Hi, > >>>> >>> > >>>> >>>I had some problems in the past using zmxodbcda and sql7. > >>>> >>> > >>>> >>>What version of sqlserver drivers are you using? > >>>> >>> > >>>> >>>If you click on the tab "browse" of your zmxodbda connection > >>>> >>>do you get a > >>>> >>>InterfaceError? > >>>> >>> > >>>> >>>thanx, > >>>> >>>Julio Dinis Silva > >>>> >>> > >>>> >>> > >>>> >>>>From: "Capesius, Alan" <CapesiusA(a)Sysmex.com> > >>>> >>>>To: bryanbz(a)2s2i.com > >>>> >>>>CC: zope(a)zope.org > >>>> >>>>Subject: [Zope] RE: ZODBC problem (and ZmxODBC) > >>>> >>>>Date: Wed, 7 Mar 2001 17:49:09 -0600 > >>>> >>>> > >>>> >>>>Excellent. The ZmxODBC driver has resolved the problem for me. > >>>> >>>>Performance is now unaffected by the slow queries. > >>>> >>>> > >>>> >>>>I'm using Access and SQL7 dbs, not sure if Access ODBC is > >>>> >>>multi-threaded, > >>>> >>>>so > >>>> >>>>I may need to run a mix of drivers, but the test server > >>>> >>>hasn't crashed yet. > >>>> >>>> > >>>> >>>>A note on the ZmxODBC install, the docs indicate that you > >>>> >>>should copy the > >>>> >>>>mx > >>>> >>>>folder to the Shared folder. This will not work (and is the > >>>> >>>default). The > >>>> >>>>coding requires that you move the mx folder up one level > >>>> >>>after extraction > >>>> >>>>it > >>>> >>>>into the Zope tree. It should be at ZopePath\lib\python\mx > >>>> >>>> > >>>> >>>>Thanks Bryan, > >>>> >>>> > >>>> >>>>Alan > >>>> >>>> > >>>> >>>> > >>>> >>>> >>>-----Original Message----- > >>>> >>>> >>>From: Bryan Baszczewski [mailto:bryanbz@2s2i.com] > >>>> >>>> >>>Sent: Wednesday, March 07, 2001 1:08 PM > >>>> >>>> >>>To: 'Capesius, Alan'; zope(a)zope.org > >>>> >>>> >>>Cc: zope-dev(a)zope.org > >>>> >>>> >>>Subject: RE: [Zope-dev] RE: ZODBC problem > >>>> >>>> >>> > >>>> >>>> >>> > >>>> >>>> >>>Alan, I am having a similar lock-out problem while > >>>> >>>> >>>performing a complex > >>>> >>>> >>>query on SQL Server 2K. All other hits cannot > >>>connect until > >>>> >>>> >>>the query > >>>> >>>> >>>returns the results. My research has so far taken me here: > >>>> >>>> >>> > >>>> >>>> >>>http://www.zope.org/Members/petrilli/DARoadmap > >>>> >>>> >>>Which is telling me I am probably using at most a > >>>Level-2 DA > >>>> >>>> >>>with my ZODBC. > >>>> >>>> >>> > >>>> >>>> >>>And then here: > >>>> >>>> >>> > >>>> >>>> > >>>> > >>>>>>>>>http://www.zope.org/Members/djay/ZmxODBC/ZmxODBC_0_0_2. > >>>tgz/README > >>>> >>>> >>>Which is a Level-3 mxZODBC DA (multithreaded). > >>>> >>>> >>> > >>>> >>>> >>>If anyone sees a problem with what I am about to do, let me > >>>> >>>> >>>know. What do > >>>> >>>> >>>you think? > >>>> >>>> >>> > >>>> >>>> >>> > >>>> >>>> >>> > >>>> >>>> >>>-----Original Message----- > >>>> >>>> >>>From: zope-dev-admin(a)zope.org > >>>> >>>> >>>[mailto:zope-dev-admin@zope.org]On Behalf > >>>> >>>> >>>Of Capesius, Alan > >>>> >>>> >>>Sent: Wednesday, March 07, 2001 12:31 PM > >>>> >>>> >>>To: zope(a)zope.org > >>>> >>>> >>>Cc: zope-dev(a)zope.org > >>>> >>>> >>>Subject: [Zope-dev] RE: ZODBC problem > >>>> >>>> >>> > >>>> >>>> >>> > >>>> >>>> >>>Thanks Dieter, I was kinda looking for a solution, I > >>>> >>>> >>>reviewed the mailing > >>>> >>>> >>>lists but do not see any solutions. I've done some more > >>>> >>>testing here: > >>>> >>>> >>> > >>>> >>>> >>>Summary: The user selects an involved financial report. The > >>>> >>>> >>>report takes > >>>> >>>> >>>about 55 seconds for Zope to prepare. The first second is > >>>> >>>> >>>the SQL server > >>>> >>>> >>>request and reply. The remaining time is Zope processing > >>>> >>>> >>>(dual 200mhz NT > >>>> >>>> >>>box). > >>>> >>>> >>> > >>>> >>>> >>>My queries are SELECT JOINS. No tables are modified at > >>>> >>>the server. > >>>> >>>> >>> > >>>> >>>> >>>The problem I see here is that Zope/ZODBCDA is holding the > >>>> >>>> >>>connection to SQL > >>>> >>>> >>>open via ODBC until all processing is complete and then > >>>> >>>> >>>issuing an SQL > >>>> >>>> >>>statement: IF @@TRANCOUNT>0 COMMIT TRAN > >>>> >>>> >>> > >>>> >>>> >>>Zope could free up this connection after one second. (at > >>>> >>>> >>>least in this case) > >>>> >>>> >>>Until Zope does the commit, other users are locked out. > >>>> >>>> >>> > >>>> >>>> >>>For read only queries, there is no need to have the > >>>> >>>request under > >>>> >>>> >>>transaction control. In any case, Zope should be able to > >>>> >>>> >>>early release the > >>>> >>>> >>>SQL connection and then process on the results. > >>>> >>>> >>> > >>>> >>>> >>>Certainly increasing processor speed will mask this problem > >>>> >>>> >>>and provide > >>>> >>>> >>>better response to users, but I'm hoping for a real fix. > >>>> >>>> >>> > >>>> >>>> >>>Thanks, > >>>> >>>> >>>Alan > >>>> >>>> >>> > >>>> >>>> >>>Network Monitor trace Wed 03/07/01 10:51:50 c:\cap1.TXT > >>>> >>>> >>> > >>>> >>>> >>>Frame Time Src MAC Addr Dst MAC Addr Protocol > >>>> >>>> >>>1 4.413 006008F6062B COMPAQ851F04 TCP > >>>> >>>> >>>2 4.413 006008F6062B COMPAQ851F04 TCP > >>>> >>>> >>>3 4.413 006008F6062B COMPAQ851F04 TCP > >>>> >>>> >>>[....] > >>>> >>>> >>>193 5.072 006008F6062B COMPAQ851F04 TCP > >>>> >>>> >>>194 5.073 COMPAQ851F04 006008F6062B TCP > >>>> >>>> >>>195 5.090 COMPAQ851F04 006008F6062B TCP > >>>> >>>> >>>196 5.090 006008F6062B COMPAQ851F04 TCP > >>>> >>>> >>>197 5.090 006008F6062B COMPAQ851F04 TCP > >>>> >>>> >>>198 5.091 COMPAQ851F04 006008F6062B TCP > >>>> >>>> >>>199 5.109 COMPAQ851F04 006008F6062B TCP > >>>> >>>> >>>200 5.127 COMPAQ851F04 006008F6062B TCP // SQL > >>>> >>>> >>>server goes idle > >>>> >>>> >>>after this > >>>> >>>> >>> > >>>> >>>> >>>// python DTML processing occurs here > >>>> >>>> >>> > >>>> >>>> >>> > >>>> >>>> >>>201 10.834 006008F6062B COMPAQ851F04 TCP // not > >>>> >>>> >>>sure what this is, > >>>> >>>> >>>Data is 0xA8 > >>>> >>>> >>>202 10.834 COMPAQ851F04 006008F6062B TCP // reply, > >>>> >>>> >>>data is empty > >>>> >>>> >>> > >>>> >>>> >>>// page returns to user at 60 second mark > >>>> >>>> >>>// then Zope closes the connection > >>>> >>>> >>>203 60.385 COMPAQ851F04 006008F6062B TCP > >>>> >>>> >>> SQL: IF @@TRANCOUNT>0 COMMIT TRAN > >>>> >>>> >>>204 60.386 006008F6062B COMPAQ851F04 TCP > >>>> >>>> >>>205 60.601 COMPAQ851F04 006008F6062B TCP > >>>> >>>> >>> > >>>> >>>> >>> > >>>> >>>> >>>>Capesius, Alan writes: > >>>> >>>> >>>> > ... > >>>> >>>> >>>> > with further testing I > >>>> >>>> >>>> > have determined that the Zope server itself is not > >>>> >>>> >>>locking up, but > >>>> >>>> >>>rather > >>>> >>>> >>>> > requests to the database (MS SQL7 via ZODBCDA) seem to > >>>> >>>> >>>be queueing up. > >>>> >>>> >>> > >>>> >>>> >>>>My memory tells me faintly that such an issue has > >>>already been > >>>> >>>> >>>>discussed in the mailing lists (zope, zope-dev). > >>>> >>>> >>>>When I remember right, ZODBCDA synchronizes all > >>>> >>>database requests > >>>> >>>> >>>>--> searchable list archives... > >>>> >>>> >>> > >>>> >>>> >>> > >>>> >>>> >>>>Dieter > >>>> >>>> >>> > >>>> >>>> >>>_______________________________________________ > >>>> >>>> >>>Zope-Dev maillist - Zope-Dev(a)zope.org > >>>> >>>> >>>http://lists.zope.org/mailman/listinfo/zope-dev > >>>> >>>> >>>** No cross posts or HTML encoding! ** > >>>> >>>> >>>(Related lists - > >>>> >>>> >>> http://lists.zope.org/mailman/listinfo/zope-announce > >>>> >>>> >>> http://lists.zope.org/mailman/listinfo/zope ) > >>>> >>>> >>> > >>>> >>>> > >>>> >>>>_______________________________________________ > >>>> >>>>Zope maillist - Zope(a)zope.org > >>>> >>>>http://lists.zope.org/mailman/listinfo/zope > >>>> >>>>** No cross posts or HTML encoding! ** > >>>> >>>>(Related lists - > >>>> >>>> http://lists.zope.org/mailman/listinfo/zope-announce > >>>> >>>> http://lists.zope.org/mailman/listinfo/zope-dev ) > >>>> >>> > >>>> >>>_____________________________________________________________ > >>>> >>>____________ > >>>> >>>Get Your Private, Free E-mail from MSN Hotmail at > >>>>http://www.hotmail.com. > >>> > >>>_____________________________________________________________ > >>>____________ > >>>Get Your Private, Free E-mail from MSN Hotmail at >http://www.hotmail.com. > >_______________________________________________ >Zope maillist - Zope(a)zope.org >http://lists.zope.org/mailman/listinfo/zope >** No cross posts or HTML encoding! ** >(Related lists - > http://lists.zope.org/mailman/listinfo/zope-announce > http://lists.zope.org/mailman/listinfo/zope-dev ) _________________________________________________________________________ Get Your Private, Free E-mail from MSN Hotmail at http://www.hotmail.com.

1 0

Re: [Zope] IPC 9 News?
by Luke Tymowski 08 Mar '01

08 Mar '01

Hello Chris, > I was wondering if anyone had any cool news from the Zope track at IPC 9 for > those of us who can't make it? Jeff of ZopeNewbies has been covering the Zope track for the past couple of days: http://weblogs.userland.com/zopenewbies/ O'Reilly has had some coverage as well, but not nearly as Zope-specific as Jeff's coverage. From O'Reilly we learn that O'Reilly will have a Zope book later this year, a more advanced book that teaches Zope by way of building an application. http://python.oreilly.com/news/pythonday2_0301.html This means 3 Zope books: two with New Riders and one from O'Reilly. Luke

1 0

RE: [Zope] RE: ZODBC problem (and ZmxODBC)
by Capesius, Alan 08 Mar '01

08 Mar '01

OOPS. I do get the error. I apologize, I was looking at the wrong ODBC_ link. ZmxODBC browser is failing as well for me. The problem is that ZmxODBC does not support the nvarchar data type (unicode varchar) in use in the Information_schema.columns table. This could render ZmxODBCDA useless under certain conditions. An interesting aside: I use three queries to pull browse info from the tables list. This is much faster than using the browser feature. Set the data source to your ODBC source. Query 1 A_Table_Scan(search for all fieldnames containing searchstring %__% wildcards OK): ====================================================================== Arguments: search_sting SQL String: SELECT table_catalog,table_name,column_name,data_type FROM INFORMATION_SCHEMA.COLUMNS where column_name like <dtml-sqlvar search_string type=string> order by ordinal_position Query 2 A_Table_Structure (Show structure of selected table): ====================================================================== Arguments: table SQL String: SELECT table_catalog,table_name,column_name,data_type FROM INFORMATION_SCHEMA.COLUMNS where table_name = <dtml-sqlvar table type=nb> order by ordinal_position Query 3 A_Tables (List tables): ====================================================================== Arguments: NONE SQL String: SELECT * FROM INFORMATION_SCHEMA.TABLES >>>-----Original Message----- >>>From: Jzlio Dinis Silva [mailto:juliodinis@hotmail.com] >>>Sent: Thursday, March 08, 2001 2:46 PM >>>To: CapesiusA(a)Sysmex.com >>>Cc: zope(a)zope.org >>>Subject: RE: [Zope] RE: ZODBC problem (and ZmxODBC) >>> >>> >>>Hi >>> >>>I have the same versions but I still get the InterfaceError. >>> >>>I am able to create a table, insert some records and >>>query the table, but commands like sp_who or sp_tables, or >>>if I try to >>>view the "browse" tab I get an InterfaceError. >>> >>>Please confirm if the only changes you made was related to moving >>>the mx directory to lib/python, and the rest was just like the >>>installations instructions said. >>> >>>Do you have the sqlserver7 on the same machine you have zope? >>> >>>Thanx, >>>Julio Dinis Silva >>> >>> >>>>From: "Capesius, Alan" <CapesiusA(a)Sysmex.com> >>>>To: Jzlio Dinis Silva <juliodinis(a)hotmail.com> >>>>Subject: RE: [Zope] RE: ZODBC problem (and ZmxODBC) >>>>Date: Thu, 8 Mar 2001 09:26:58 -0600 >>>> >>>>No problems with the browse tab here. >>>>I am running MDAC 2.5 drivers. >>>>Thats 3.70.08.20 for SQL Server. >>>>SQL is SQL7 SP2 >>>>And the ZmxODBC is 0.0.2 release. >>>> >>>> >>>> >>>> >>>-----Original Message----- >>>> >>>From: Jzlio Dinis Silva [mailto:juliodinis@hotmail.com] >>>> >>>Sent: Thursday, March 08, 2001 6:16 AM >>>> >>>To: CapesiusA(a)Sysmex.com >>>> >>>Cc: zope(a)zope.org >>>> >>>Subject: Re: [Zope] RE: ZODBC problem (and ZmxODBC) >>>> >>> >>>> >>> >>>> >>>Hi, >>>> >>> >>>> >>>I had some problems in the past using zmxodbcda and sql7. >>>> >>> >>>> >>>What version of sqlserver drivers are you using? >>>> >>> >>>> >>>If you click on the tab "browse" of your zmxodbda connection >>>> >>>do you get a >>>> >>>InterfaceError? >>>> >>> >>>> >>>thanx, >>>> >>>Julio Dinis Silva >>>> >>> >>>> >>> >>>> >>>>From: "Capesius, Alan" <CapesiusA(a)Sysmex.com> >>>> >>>>To: bryanbz(a)2s2i.com >>>> >>>>CC: zope(a)zope.org >>>> >>>>Subject: [Zope] RE: ZODBC problem (and ZmxODBC) >>>> >>>>Date: Wed, 7 Mar 2001 17:49:09 -0600 >>>> >>>> >>>> >>>>Excellent. The ZmxODBC driver has resolved the problem for me. >>>> >>>>Performance is now unaffected by the slow queries. >>>> >>>> >>>> >>>>I'm using Access and SQL7 dbs, not sure if Access ODBC is >>>> >>>multi-threaded, >>>> >>>>so >>>> >>>>I may need to run a mix of drivers, but the test server >>>> >>>hasn't crashed yet. >>>> >>>> >>>> >>>>A note on the ZmxODBC install, the docs indicate that you >>>> >>>should copy the >>>> >>>>mx >>>> >>>>folder to the Shared folder. This will not work (and is the >>>> >>>default). The >>>> >>>>coding requires that you move the mx folder up one level >>>> >>>after extraction >>>> >>>>it >>>> >>>>into the Zope tree. It should be at ZopePath\lib\python\mx >>>> >>>> >>>> >>>>Thanks Bryan, >>>> >>>> >>>> >>>>Alan >>>> >>>> >>>> >>>> >>>> >>>> >>>-----Original Message----- >>>> >>>> >>>From: Bryan Baszczewski [mailto:bryanbz@2s2i.com] >>>> >>>> >>>Sent: Wednesday, March 07, 2001 1:08 PM >>>> >>>> >>>To: 'Capesius, Alan'; zope(a)zope.org >>>> >>>> >>>Cc: zope-dev(a)zope.org >>>> >>>> >>>Subject: RE: [Zope-dev] RE: ZODBC problem >>>> >>>> >>> >>>> >>>> >>> >>>> >>>> >>>Alan, I am having a similar lock-out problem while >>>> >>>> >>>performing a complex >>>> >>>> >>>query on SQL Server 2K. All other hits cannot >>>connect until >>>> >>>> >>>the query >>>> >>>> >>>returns the results. My research has so far taken me here: >>>> >>>> >>> >>>> >>>> >>>http://www.zope.org/Members/petrilli/DARoadmap >>>> >>>> >>>Which is telling me I am probably using at most a >>>Level-2 DA >>>> >>>> >>>with my ZODBC. >>>> >>>> >>> >>>> >>>> >>>And then here: >>>> >>>> >>> >>>> >>>> >>>> >>>>>>>>>http://www.zope.org/Members/djay/ZmxODBC/ZmxODBC_0_0_2. >>>tgz/README >>>> >>>> >>>Which is a Level-3 mxZODBC DA (multithreaded). >>>> >>>> >>> >>>> >>>> >>>If anyone sees a problem with what I am about to do, let me >>>> >>>> >>>know. What do >>>> >>>> >>>you think? >>>> >>>> >>> >>>> >>>> >>> >>>> >>>> >>> >>>> >>>> >>>-----Original Message----- >>>> >>>> >>>From: zope-dev-admin(a)zope.org >>>> >>>> >>>[mailto:zope-dev-admin@zope.org]On Behalf >>>> >>>> >>>Of Capesius, Alan >>>> >>>> >>>Sent: Wednesday, March 07, 2001 12:31 PM >>>> >>>> >>>To: zope(a)zope.org >>>> >>>> >>>Cc: zope-dev(a)zope.org >>>> >>>> >>>Subject: [Zope-dev] RE: ZODBC problem >>>> >>>> >>> >>>> >>>> >>> >>>> >>>> >>>Thanks Dieter, I was kinda looking for a solution, I >>>> >>>> >>>reviewed the mailing >>>> >>>> >>>lists but do not see any solutions. I've done some more >>>> >>>testing here: >>>> >>>> >>> >>>> >>>> >>>Summary: The user selects an involved financial report. The >>>> >>>> >>>report takes >>>> >>>> >>>about 55 seconds for Zope to prepare. The first second is >>>> >>>> >>>the SQL server >>>> >>>> >>>request and reply. The remaining time is Zope processing >>>> >>>> >>>(dual 200mhz NT >>>> >>>> >>>box). >>>> >>>> >>> >>>> >>>> >>>My queries are SELECT JOINS. No tables are modified at >>>> >>>the server. >>>> >>>> >>> >>>> >>>> >>>The problem I see here is that Zope/ZODBCDA is holding the >>>> >>>> >>>connection to SQL >>>> >>>> >>>open via ODBC until all processing is complete and then >>>> >>>> >>>issuing an SQL >>>> >>>> >>>statement: IF @@TRANCOUNT>0 COMMIT TRAN >>>> >>>> >>> >>>> >>>> >>>Zope could free up this connection after one second. (at >>>> >>>> >>>least in this case) >>>> >>>> >>>Until Zope does the commit, other users are locked out. >>>> >>>> >>> >>>> >>>> >>>For read only queries, there is no need to have the >>>> >>>request under >>>> >>>> >>>transaction control. In any case, Zope should be able to >>>> >>>> >>>early release the >>>> >>>> >>>SQL connection and then process on the results. >>>> >>>> >>> >>>> >>>> >>>Certainly increasing processor speed will mask this problem >>>> >>>> >>>and provide >>>> >>>> >>>better response to users, but I'm hoping for a real fix. >>>> >>>> >>> >>>> >>>> >>>Thanks, >>>> >>>> >>>Alan >>>> >>>> >>> >>>> >>>> >>>Network Monitor trace Wed 03/07/01 10:51:50 c:\cap1.TXT >>>> >>>> >>> >>>> >>>> >>>Frame Time Src MAC Addr Dst MAC Addr Protocol >>>> >>>> >>>1 4.413 006008F6062B COMPAQ851F04 TCP >>>> >>>> >>>2 4.413 006008F6062B COMPAQ851F04 TCP >>>> >>>> >>>3 4.413 006008F6062B COMPAQ851F04 TCP >>>> >>>> >>>[....] >>>> >>>> >>>193 5.072 006008F6062B COMPAQ851F04 TCP >>>> >>>> >>>194 5.073 COMPAQ851F04 006008F6062B TCP >>>> >>>> >>>195 5.090 COMPAQ851F04 006008F6062B TCP >>>> >>>> >>>196 5.090 006008F6062B COMPAQ851F04 TCP >>>> >>>> >>>197 5.090 006008F6062B COMPAQ851F04 TCP >>>> >>>> >>>198 5.091 COMPAQ851F04 006008F6062B TCP >>>> >>>> >>>199 5.109 COMPAQ851F04 006008F6062B TCP >>>> >>>> >>>200 5.127 COMPAQ851F04 006008F6062B TCP // SQL >>>> >>>> >>>server goes idle >>>> >>>> >>>after this >>>> >>>> >>> >>>> >>>> >>>// python DTML processing occurs here >>>> >>>> >>> >>>> >>>> >>> >>>> >>>> >>>201 10.834 006008F6062B COMPAQ851F04 TCP // not >>>> >>>> >>>sure what this is, >>>> >>>> >>>Data is 0xA8 >>>> >>>> >>>202 10.834 COMPAQ851F04 006008F6062B TCP // reply, >>>> >>>> >>>data is empty >>>> >>>> >>> >>>> >>>> >>>// page returns to user at 60 second mark >>>> >>>> >>>// then Zope closes the connection >>>> >>>> >>>203 60.385 COMPAQ851F04 006008F6062B TCP >>>> >>>> >>> SQL: IF @@TRANCOUNT>0 COMMIT TRAN >>>> >>>> >>>204 60.386 006008F6062B COMPAQ851F04 TCP >>>> >>>> >>>205 60.601 COMPAQ851F04 006008F6062B TCP >>>> >>>> >>> >>>> >>>> >>> >>>> >>>> >>>>Capesius, Alan writes: >>>> >>>> >>>> > ... >>>> >>>> >>>> > with further testing I >>>> >>>> >>>> > have determined that the Zope server itself is not >>>> >>>> >>>locking up, but >>>> >>>> >>>rather >>>> >>>> >>>> > requests to the database (MS SQL7 via ZODBCDA) seem to >>>> >>>> >>>be queueing up. >>>> >>>> >>> >>>> >>>> >>>>My memory tells me faintly that such an issue has >>>already been >>>> >>>> >>>>discussed in the mailing lists (zope, zope-dev). >>>> >>>> >>>>When I remember right, ZODBCDA synchronizes all >>>> >>>database requests >>>> >>>> >>>>--> searchable list archives... >>>> >>>> >>> >>>> >>>> >>> >>>> >>>> >>>>Dieter >>>> >>>> >>> >>>> >>>> >>>_______________________________________________ >>>> >>>> >>>Zope-Dev maillist - Zope-Dev(a)zope.org >>>> >>>> >>>http://lists.zope.org/mailman/listinfo/zope-dev >>>> >>>> >>>** No cross posts or HTML encoding! ** >>>> >>>> >>>(Related lists - >>>> >>>> >>> http://lists.zope.org/mailman/listinfo/zope-announce >>>> >>>> >>> http://lists.zope.org/mailman/listinfo/zope ) >>>> >>>> >>> >>>> >>>> >>>> >>>>_______________________________________________ >>>> >>>>Zope maillist - Zope(a)zope.org >>>> >>>>http://lists.zope.org/mailman/listinfo/zope >>>> >>>>** No cross posts or HTML encoding! ** >>>> >>>>(Related lists - >>>> >>>> http://lists.zope.org/mailman/listinfo/zope-announce >>>> >>>> http://lists.zope.org/mailman/listinfo/zope-dev ) >>>> >>> >>>> >>>_____________________________________________________________ >>>> >>>____________ >>>> >>>Get Your Private, Free E-mail from MSN Hotmail at >>>>http://www.hotmail.com. >>> >>>_____________________________________________________________ >>>____________ >>>Get Your Private, Free E-mail from MSN Hotmail at http://www.hotmail.com.

1 0

RE: [Zope] RE: ZODBC problem (and ZmxODBC)
by J�lio Dinis Silva 08 Mar '01

08 Mar '01

Does anyone have ZmxOdbc working with sql7.0 sp1, i.e, can see the "browse" tab without a InterfaceError? Thanx, Julio Dinis Silva >From: "Capesius, Alan" <CapesiusA(a)Sysmex.com> >To: Jzlio Dinis Silva <juliodinis(a)hotmail.com> >Subject: RE: [Zope] RE: ZODBC problem (and ZmxODBC) >Date: Thu, 8 Mar 2001 09:26:58 -0600 > >No problems with the browse tab here. >I am running MDAC 2.5 drivers. >Thats 3.70.08.20 for SQL Server. >SQL is SQL7 SP2 >And the ZmxODBC is 0.0.2 release. > > > > >>>-----Original Message----- > >>>From: Jzlio Dinis Silva [mailto:juliodinis@hotmail.com] > >>>Sent: Thursday, March 08, 2001 6:16 AM > >>>To: CapesiusA(a)Sysmex.com > >>>Cc: zope(a)zope.org > >>>Subject: Re: [Zope] RE: ZODBC problem (and ZmxODBC) > >>> > >>> > >>>Hi, > >>> > >>>I had some problems in the past using zmxodbcda and sql7. > >>> > >>>What version of sqlserver drivers are you using? > >>> > >>>If you click on the tab "browse" of your zmxodbda connection > >>>do you get a > >>>InterfaceError? > >>> > >>>thanx, > >>>Julio Dinis Silva > >>> > >>> > >>>>From: "Capesius, Alan" <CapesiusA(a)Sysmex.com> > >>>>To: bryanbz(a)2s2i.com > >>>>CC: zope(a)zope.org > >>>>Subject: [Zope] RE: ZODBC problem (and ZmxODBC) > >>>>Date: Wed, 7 Mar 2001 17:49:09 -0600 > >>>> > >>>>Excellent. The ZmxODBC driver has resolved the problem for me. > >>>>Performance is now unaffected by the slow queries. > >>>> > >>>>I'm using Access and SQL7 dbs, not sure if Access ODBC is > >>>multi-threaded, > >>>>so > >>>>I may need to run a mix of drivers, but the test server > >>>hasn't crashed yet. > >>>> > >>>>A note on the ZmxODBC install, the docs indicate that you > >>>should copy the > >>>>mx > >>>>folder to the Shared folder. This will not work (and is the > >>>default). The > >>>>coding requires that you move the mx folder up one level > >>>after extraction > >>>>it > >>>>into the Zope tree. It should be at ZopePath\lib\python\mx > >>>> > >>>>Thanks Bryan, > >>>> > >>>>Alan > >>>> > >>>> > >>>> >>>-----Original Message----- > >>>> >>>From: Bryan Baszczewski [mailto:bryanbz@2s2i.com] > >>>> >>>Sent: Wednesday, March 07, 2001 1:08 PM > >>>> >>>To: 'Capesius, Alan'; zope(a)zope.org > >>>> >>>Cc: zope-dev(a)zope.org > >>>> >>>Subject: RE: [Zope-dev] RE: ZODBC problem > >>>> >>> > >>>> >>> > >>>> >>>Alan, I am having a similar lock-out problem while > >>>> >>>performing a complex > >>>> >>>query on SQL Server 2K. All other hits cannot connect until > >>>> >>>the query > >>>> >>>returns the results. My research has so far taken me here: > >>>> >>> > >>>> >>>http://www.zope.org/Members/petrilli/DARoadmap > >>>> >>>Which is telling me I am probably using at most a Level-2 DA > >>>> >>>with my ZODBC. > >>>> >>> > >>>> >>>And then here: > >>>> >>> > >>>> > >>>>>>http://www.zope.org/Members/djay/ZmxODBC/ZmxODBC_0_0_2.tgz/README > >>>> >>>Which is a Level-3 mxZODBC DA (multithreaded). > >>>> >>> > >>>> >>>If anyone sees a problem with what I am about to do, let me > >>>> >>>know. What do > >>>> >>>you think? > >>>> >>> > >>>> >>> > >>>> >>> > >>>> >>>-----Original Message----- > >>>> >>>From: zope-dev-admin(a)zope.org > >>>> >>>[mailto:zope-dev-admin@zope.org]On Behalf > >>>> >>>Of Capesius, Alan > >>>> >>>Sent: Wednesday, March 07, 2001 12:31 PM > >>>> >>>To: zope(a)zope.org > >>>> >>>Cc: zope-dev(a)zope.org > >>>> >>>Subject: [Zope-dev] RE: ZODBC problem > >>>> >>> > >>>> >>> > >>>> >>>Thanks Dieter, I was kinda looking for a solution, I > >>>> >>>reviewed the mailing > >>>> >>>lists but do not see any solutions. I've done some more > >>>testing here: > >>>> >>> > >>>> >>>Summary: The user selects an involved financial report. The > >>>> >>>report takes > >>>> >>>about 55 seconds for Zope to prepare. The first second is > >>>> >>>the SQL server > >>>> >>>request and reply. The remaining time is Zope processing > >>>> >>>(dual 200mhz NT > >>>> >>>box). > >>>> >>> > >>>> >>>My queries are SELECT JOINS. No tables are modified at > >>>the server. > >>>> >>> > >>>> >>>The problem I see here is that Zope/ZODBCDA is holding the > >>>> >>>connection to SQL > >>>> >>>open via ODBC until all processing is complete and then > >>>> >>>issuing an SQL > >>>> >>>statement: IF @@TRANCOUNT>0 COMMIT TRAN > >>>> >>> > >>>> >>>Zope could free up this connection after one second. (at > >>>> >>>least in this case) > >>>> >>>Until Zope does the commit, other users are locked out. > >>>> >>> > >>>> >>>For read only queries, there is no need to have the > >>>request under > >>>> >>>transaction control. In any case, Zope should be able to > >>>> >>>early release the > >>>> >>>SQL connection and then process on the results. > >>>> >>> > >>>> >>>Certainly increasing processor speed will mask this problem > >>>> >>>and provide > >>>> >>>better response to users, but I'm hoping for a real fix. > >>>> >>> > >>>> >>>Thanks, > >>>> >>>Alan > >>>> >>> > >>>> >>>Network Monitor trace Wed 03/07/01 10:51:50 c:\cap1.TXT > >>>> >>> > >>>> >>>Frame Time Src MAC Addr Dst MAC Addr Protocol > >>>> >>>1 4.413 006008F6062B COMPAQ851F04 TCP > >>>> >>>2 4.413 006008F6062B COMPAQ851F04 TCP > >>>> >>>3 4.413 006008F6062B COMPAQ851F04 TCP > >>>> >>>[....] > >>>> >>>193 5.072 006008F6062B COMPAQ851F04 TCP > >>>> >>>194 5.073 COMPAQ851F04 006008F6062B TCP > >>>> >>>195 5.090 COMPAQ851F04 006008F6062B TCP > >>>> >>>196 5.090 006008F6062B COMPAQ851F04 TCP > >>>> >>>197 5.090 006008F6062B COMPAQ851F04 TCP > >>>> >>>198 5.091 COMPAQ851F04 006008F6062B TCP > >>>> >>>199 5.109 COMPAQ851F04 006008F6062B TCP > >>>> >>>200 5.127 COMPAQ851F04 006008F6062B TCP // SQL > >>>> >>>server goes idle > >>>> >>>after this > >>>> >>> > >>>> >>>// python DTML processing occurs here > >>>> >>> > >>>> >>> > >>>> >>>201 10.834 006008F6062B COMPAQ851F04 TCP // not > >>>> >>>sure what this is, > >>>> >>>Data is 0xA8 > >>>> >>>202 10.834 COMPAQ851F04 006008F6062B TCP // reply, > >>>> >>>data is empty > >>>> >>> > >>>> >>>// page returns to user at 60 second mark > >>>> >>>// then Zope closes the connection > >>>> >>>203 60.385 COMPAQ851F04 006008F6062B TCP > >>>> >>> SQL: IF @@TRANCOUNT>0 COMMIT TRAN > >>>> >>>204 60.386 006008F6062B COMPAQ851F04 TCP > >>>> >>>205 60.601 COMPAQ851F04 006008F6062B TCP > >>>> >>> > >>>> >>> > >>>> >>>>Capesius, Alan writes: > >>>> >>>> > ... > >>>> >>>> > with further testing I > >>>> >>>> > have determined that the Zope server itself is not > >>>> >>>locking up, but > >>>> >>>rather > >>>> >>>> > requests to the database (MS SQL7 via ZODBCDA) seem to > >>>> >>>be queueing up. > >>>> >>> > >>>> >>>>My memory tells me faintly that such an issue has already been > >>>> >>>>discussed in the mailing lists (zope, zope-dev). > >>>> >>>>When I remember right, ZODBCDA synchronizes all > >>>database requests > >>>> >>>>--> searchable list archives... > >>>> >>> > >>>> >>> > >>>> >>>>Dieter > >>>> >>> > >>>> >>>_______________________________________________ > >>>> >>>Zope-Dev maillist - Zope-Dev(a)zope.org > >>>> >>>http://lists.zope.org/mailman/listinfo/zope-dev > >>>> >>>** No cross posts or HTML encoding! ** > >>>> >>>(Related lists - > >>>> >>> http://lists.zope.org/mailman/listinfo/zope-announce > >>>> >>> http://lists.zope.org/mailman/listinfo/zope ) > >>>> >>> > >>>> > >>>>_______________________________________________ > >>>>Zope maillist - Zope(a)zope.org > >>>>http://lists.zope.org/mailman/listinfo/zope > >>>>** No cross posts or HTML encoding! ** > >>>>(Related lists - > >>>> http://lists.zope.org/mailman/listinfo/zope-announce > >>>> http://lists.zope.org/mailman/listinfo/zope-dev ) > >>> > >>>_____________________________________________________________ > >>>____________ > >>>Get Your Private, Free E-mail from MSN Hotmail at >http://www.hotmail.com. _________________________________________________________________________ Get Your Private, Free E-mail from MSN Hotmail at http://www.hotmail.com.

1 0

RE: [Zope] Telnet to Port 8080
by Farrell, Troy 08 Mar '01

08 Mar '01

Please let us know exactly what you are typing. Your request may be flawed, or you might not be allowed to connect (IPCHAINS) Troy -----Original Message----- From: karthick ramanarayanan [mailto:karthick@pepco.no] Sent: Thursday, March 08, 2001 2:42 PM To: zope(a)zope.org Subject: [Zope] Telnet to Port 8080 Why Am I not able to telnet to port 8080 and do a , GET / like you do on port 80. It just hangs. Whats the problem. Bye, A.R.Karthick _______________________________________________ Zope maillist - Zope(a)zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )

1 0

Repeated Zope 2.2 lockups on RH linux 7
by Brad Clements 08 Mar '01

08 Mar '01

My customer is getting pretty upset. Where running Zope 2.2.3 on RH Linux 7 using the Zope bundled python. We're using gvib and have moved the Interbase server onto windows due to the broken pipe error bug in the Linux SS Interbase server. Every few hours the server just "locks up". It accepts TCP connections, but GET / returns nothing. I'm running with -M and -D options. I have up to 10 threads allowed. Using gdb, I can attach to each thread. All the threads are waiting for the global lock: at ../sysdeps/unix/sysv/linux/sigsuspend.c:45 #1 0x400347e9 in __pthread_wait_for_restart_signal (self=0xbf7ffc00) at pthread.c:901 #2 0x40030b8c in pthread_cond_wait (cond=0x8693f1c, mutex=0x8693f28) at restart.h:34 #3 0x80631f2 in PyThread_acquire_lock (lock=0x8693f18, waitflag=1) at thread_pthread.h:318 #4 0x807a63d in lock_PyThread_acquire_lock (self=0x8646338, args=0x0) at ./threadmodule.c:100 Except for one thread which is blocked here: 0x4008de75 in __sigsuspend (set=0x869623c) at ../sysdeps/unix/sysv/linux/sigsuspend.c:45 #1 0x400347e9 in __pthread_wait_for_restart_signal (self=0x4003e360) at pthread.c:901 #2 0x40036ad9 in __pthread_alt_lock (lock=0x40183720, self=0x0) at restart.h:34 #3 0x40032b26 in __pthread_mutex_lock (mutex=0x40183710) at mutex.c:120 #4 0x400dee48 in __libc_free (mem=0x8c09278) at malloc.c:3052 #5 0x4003234b in pthread_exited (pid=11887) at manager.c:707 #6 0x40032709 in pthread_reap_children () at manager.c:787 #7 0x40031a28 in __pthread_manager (arg=0x13) at manager.c:158 I can't find manager.c so I can't see if this code does, or does not have the global lock. Is this the "manager" thread, and is this normal? Perhaps this one is a red herring and there's another cause? -- Anyone have suggestions for how to diagnose this? Customer is getting pretty pissed. He has over 100 users of this site (import export operation) Brad Clements, bkc(a)murkworks.com (315)268-1000 http://www.murkworks.com (315)268-9812 Fax netmeeting: ils://ils.murkworks.com AOL-IM: BKClements

2 1

RE: [Zope] RE: ZODBC problem (and ZmxODBC)
by J�lio Dinis Silva 08 Mar '01

08 Mar '01

Hi I have the same versions but I still get the InterfaceError. I am able to create a table, insert some records and query the table, but commands like sp_who or sp_tables, or if I try to view the "browse" tab I get an InterfaceError. Please confirm if the only changes you made was related to moving the mx directory to lib/python, and the rest was just like the installations instructions said. Do you have the sqlserver7 on the same machine you have zope? Thanx, Julio Dinis Silva >From: "Capesius, Alan" <CapesiusA(a)Sysmex.com> >To: Jzlio Dinis Silva <juliodinis(a)hotmail.com> >Subject: RE: [Zope] RE: ZODBC problem (and ZmxODBC) >Date: Thu, 8 Mar 2001 09:26:58 -0600 > >No problems with the browse tab here. >I am running MDAC 2.5 drivers. >Thats 3.70.08.20 for SQL Server. >SQL is SQL7 SP2 >And the ZmxODBC is 0.0.2 release. > > > > >>>-----Original Message----- > >>>From: Jzlio Dinis Silva [mailto:juliodinis@hotmail.com] > >>>Sent: Thursday, March 08, 2001 6:16 AM > >>>To: CapesiusA(a)Sysmex.com > >>>Cc: zope(a)zope.org > >>>Subject: Re: [Zope] RE: ZODBC problem (and ZmxODBC) > >>> > >>> > >>>Hi, > >>> > >>>I had some problems in the past using zmxodbcda and sql7. > >>> > >>>What version of sqlserver drivers are you using? > >>> > >>>If you click on the tab "browse" of your zmxodbda connection > >>>do you get a > >>>InterfaceError? > >>> > >>>thanx, > >>>Julio Dinis Silva > >>> > >>> > >>>>From: "Capesius, Alan" <CapesiusA(a)Sysmex.com> > >>>>To: bryanbz(a)2s2i.com > >>>>CC: zope(a)zope.org > >>>>Subject: [Zope] RE: ZODBC problem (and ZmxODBC) > >>>>Date: Wed, 7 Mar 2001 17:49:09 -0600 > >>>> > >>>>Excellent. The ZmxODBC driver has resolved the problem for me. > >>>>Performance is now unaffected by the slow queries. > >>>> > >>>>I'm using Access and SQL7 dbs, not sure if Access ODBC is > >>>multi-threaded, > >>>>so > >>>>I may need to run a mix of drivers, but the test server > >>>hasn't crashed yet. > >>>> > >>>>A note on the ZmxODBC install, the docs indicate that you > >>>should copy the > >>>>mx > >>>>folder to the Shared folder. This will not work (and is the > >>>default). The > >>>>coding requires that you move the mx folder up one level > >>>after extraction > >>>>it > >>>>into the Zope tree. It should be at ZopePath\lib\python\mx > >>>> > >>>>Thanks Bryan, > >>>> > >>>>Alan > >>>> > >>>> > >>>> >>>-----Original Message----- > >>>> >>>From: Bryan Baszczewski [mailto:bryanbz@2s2i.com] > >>>> >>>Sent: Wednesday, March 07, 2001 1:08 PM > >>>> >>>To: 'Capesius, Alan'; zope(a)zope.org > >>>> >>>Cc: zope-dev(a)zope.org > >>>> >>>Subject: RE: [Zope-dev] RE: ZODBC problem > >>>> >>> > >>>> >>> > >>>> >>>Alan, I am having a similar lock-out problem while > >>>> >>>performing a complex > >>>> >>>query on SQL Server 2K. All other hits cannot connect until > >>>> >>>the query > >>>> >>>returns the results. My research has so far taken me here: > >>>> >>> > >>>> >>>http://www.zope.org/Members/petrilli/DARoadmap > >>>> >>>Which is telling me I am probably using at most a Level-2 DA > >>>> >>>with my ZODBC. > >>>> >>> > >>>> >>>And then here: > >>>> >>> > >>>> > >>>>>>http://www.zope.org/Members/djay/ZmxODBC/ZmxODBC_0_0_2.tgz/README > >>>> >>>Which is a Level-3 mxZODBC DA (multithreaded). > >>>> >>> > >>>> >>>If anyone sees a problem with what I am about to do, let me > >>>> >>>know. What do > >>>> >>>you think? > >>>> >>> > >>>> >>> > >>>> >>> > >>>> >>>-----Original Message----- > >>>> >>>From: zope-dev-admin(a)zope.org > >>>> >>>[mailto:zope-dev-admin@zope.org]On Behalf > >>>> >>>Of Capesius, Alan > >>>> >>>Sent: Wednesday, March 07, 2001 12:31 PM > >>>> >>>To: zope(a)zope.org > >>>> >>>Cc: zope-dev(a)zope.org > >>>> >>>Subject: [Zope-dev] RE: ZODBC problem > >>>> >>> > >>>> >>> > >>>> >>>Thanks Dieter, I was kinda looking for a solution, I > >>>> >>>reviewed the mailing > >>>> >>>lists but do not see any solutions. I've done some more > >>>testing here: > >>>> >>> > >>>> >>>Summary: The user selects an involved financial report. The > >>>> >>>report takes > >>>> >>>about 55 seconds for Zope to prepare. The first second is > >>>> >>>the SQL server > >>>> >>>request and reply. The remaining time is Zope processing > >>>> >>>(dual 200mhz NT > >>>> >>>box). > >>>> >>> > >>>> >>>My queries are SELECT JOINS. No tables are modified at > >>>the server. > >>>> >>> > >>>> >>>The problem I see here is that Zope/ZODBCDA is holding the > >>>> >>>connection to SQL > >>>> >>>open via ODBC until all processing is complete and then > >>>> >>>issuing an SQL > >>>> >>>statement: IF @@TRANCOUNT>0 COMMIT TRAN > >>>> >>> > >>>> >>>Zope could free up this connection after one second. (at > >>>> >>>least in this case) > >>>> >>>Until Zope does the commit, other users are locked out. > >>>> >>> > >>>> >>>For read only queries, there is no need to have the > >>>request under > >>>> >>>transaction control. In any case, Zope should be able to > >>>> >>>early release the > >>>> >>>SQL connection and then process on the results. > >>>> >>> > >>>> >>>Certainly increasing processor speed will mask this problem > >>>> >>>and provide > >>>> >>>better response to users, but I'm hoping for a real fix. > >>>> >>> > >>>> >>>Thanks, > >>>> >>>Alan > >>>> >>> > >>>> >>>Network Monitor trace Wed 03/07/01 10:51:50 c:\cap1.TXT > >>>> >>> > >>>> >>>Frame Time Src MAC Addr Dst MAC Addr Protocol > >>>> >>>1 4.413 006008F6062B COMPAQ851F04 TCP > >>>> >>>2 4.413 006008F6062B COMPAQ851F04 TCP > >>>> >>>3 4.413 006008F6062B COMPAQ851F04 TCP > >>>> >>>[....] > >>>> >>>193 5.072 006008F6062B COMPAQ851F04 TCP > >>>> >>>194 5.073 COMPAQ851F04 006008F6062B TCP > >>>> >>>195 5.090 COMPAQ851F04 006008F6062B TCP > >>>> >>>196 5.090 006008F6062B COMPAQ851F04 TCP > >>>> >>>197 5.090 006008F6062B COMPAQ851F04 TCP > >>>> >>>198 5.091 COMPAQ851F04 006008F6062B TCP > >>>> >>>199 5.109 COMPAQ851F04 006008F6062B TCP > >>>> >>>200 5.127 COMPAQ851F04 006008F6062B TCP // SQL > >>>> >>>server goes idle > >>>> >>>after this > >>>> >>> > >>>> >>>// python DTML processing occurs here > >>>> >>> > >>>> >>> > >>>> >>>201 10.834 006008F6062B COMPAQ851F04 TCP // not > >>>> >>>sure what this is, > >>>> >>>Data is 0xA8 > >>>> >>>202 10.834 COMPAQ851F04 006008F6062B TCP // reply, > >>>> >>>data is empty > >>>> >>> > >>>> >>>// page returns to user at 60 second mark > >>>> >>>// then Zope closes the connection > >>>> >>>203 60.385 COMPAQ851F04 006008F6062B TCP > >>>> >>> SQL: IF @@TRANCOUNT>0 COMMIT TRAN > >>>> >>>204 60.386 006008F6062B COMPAQ851F04 TCP > >>>> >>>205 60.601 COMPAQ851F04 006008F6062B TCP > >>>> >>> > >>>> >>> > >>>> >>>>Capesius, Alan writes: > >>>> >>>> > ... > >>>> >>>> > with further testing I > >>>> >>>> > have determined that the Zope server itself is not > >>>> >>>locking up, but > >>>> >>>rather > >>>> >>>> > requests to the database (MS SQL7 via ZODBCDA) seem to > >>>> >>>be queueing up. > >>>> >>> > >>>> >>>>My memory tells me faintly that such an issue has already been > >>>> >>>>discussed in the mailing lists (zope, zope-dev). > >>>> >>>>When I remember right, ZODBCDA synchronizes all > >>>database requests > >>>> >>>>--> searchable list archives... > >>>> >>> > >>>> >>> > >>>> >>>>Dieter > >>>> >>> > >>>> >>>_______________________________________________ > >>>> >>>Zope-Dev maillist - Zope-Dev(a)zope.org > >>>> >>>http://lists.zope.org/mailman/listinfo/zope-dev > >>>> >>>** No cross posts or HTML encoding! ** > >>>> >>>(Related lists - > >>>> >>> http://lists.zope.org/mailman/listinfo/zope-announce > >>>> >>> http://lists.zope.org/mailman/listinfo/zope ) > >>>> >>> > >>>> > >>>>_______________________________________________ > >>>>Zope maillist - Zope(a)zope.org > >>>>http://lists.zope.org/mailman/listinfo/zope > >>>>** No cross posts or HTML encoding! ** > >>>>(Related lists - > >>>> http://lists.zope.org/mailman/listinfo/zope-announce > >>>> http://lists.zope.org/mailman/listinfo/zope-dev ) > >>> > >>>_____________________________________________________________ > >>>____________ > >>>Get Your Private, Free E-mail from MSN Hotmail at >http://www.hotmail.com. _________________________________________________________________________ Get Your Private, Free E-mail from MSN Hotmail at http://www.hotmail.com.

1 0

copying a file from folder to folder
by Ian Campbell 08 Mar '01

08 Mar '01

I`m trying to do what i think should be quite a simple operation, i have a file in the protected folder and when the user clicks to make it public i want to transfer it, i`ve been experimenting with manage_cutObjects and manage_pasteObjects, but have had no success so i`m sure i`m making a stupid mistake somewhere. could anyone give me some pointers? moveFile | --------- | | protected public Thanks in advance Ian

1 0

Re: [Zope] unsettable variable?
by Joh Johannsen 08 Mar '01

08 Mar '01

Thanks, that is what is happening. However, I still don't understand it. If I do "REQUEST.set" I set it in the REQUEST namespace. But where is the one that came from <dtml-in...>? And how can I set that one? Thanks, Regards, JJ karthick ramanarayanan wrote: > > Hi, > Try printing, > <dtml-var action_text> > and > <dtml-var "REQUEST['action_text']"> > > Should work, > Bye, > A.R.Karthick > > > I've got a case like this: > > > > <dtml-in get_action_text> > > <dtml-if expr="action_text=='WIPE_OUT_THIS_VALUE'"> > > <dtml-call "REQUEST.set('action_text','atest')"> > > <dtml-call "REQUEST.set('zction_text','ztest')"> > > action_text is <dtml-var action_text>, > > zction_text is <dtml-var zction_text> > > </dtml-if> > > > > > > Here is what shows up for the values when the above is run: > > > > action_text is WIPE_OUT_THIS_VALUE, zction_text is ztest > > > > > > Why can I not set the 'action_text'? > > > > It really seems like there must be something really obviously stupid in > > what I am doing, but I just can't see it. > > > > Are there cases where a REQUEST.set will have no effect on a dtml-var? > > > > Regards, > > > > JJ > >

2 1