Hi all, I have a problem with my Zope, he hangs unexpectly if i view a special Method which generates Diagrams with data from a PostgresDB. The data are selected by a timespan( default is 24 Hours ). The Method works as descripted bellow: First when i call foo, then the HTML-Code is rendered with some images-tags, which are generated by selects. The image tags are calling the method foo which returns image data. If i want my diagrams from 2001-06-01 5:00 to 2001-06-01 12:05 everything works fine. If i want my diagrams from 2001-06-01 5:00 to 2001-06-01 12:10 Zope hangs, no exception no log entry, Zope only hangs. If i want my diagrams from 2001-06-01 5:05 to 2001-06-01 12:10 which is the same timespan as example 1 Zope hangs too, no exception no log entry, Zope only hangs. If i view the postgres logs the nothing happens. Could anyone help me to find the problem or the place Zope is hanging thanks as P.S.: Exact the same problem occurs when i you another PostgresDA ????
Hi Andre, What OS? I've had lots of trouble with Postgres and threads on FreeBSD. Have you tried starting Zope with '-D' to see if threads are an issue? -steve Andre Schubert wrote:
Hi all,
I have a problem with my Zope, he hangs unexpectly if i view a special Method which generates Diagrams with data from a PostgresDB. The data are selected by a timespan( default is 24 Hours ). The Method works as descripted bellow:
First when i call foo, then the HTML-Code is rendered with some images-tags, which are generated by selects. The image tags are calling the method foo which returns image data.
If i want my diagrams from 2001-06-01 5:00 to 2001-06-01 12:05 everything works fine. If i want my diagrams from 2001-06-01 5:00 to 2001-06-01 12:10 Zope hangs, no exception no log entry, Zope only hangs. If i want my diagrams from 2001-06-01 5:05 to 2001-06-01 12:10 which is the same timespan as example 1 Zope hangs too, no exception no log entry, Zope only hangs.
If i view the postgres logs the nothing happens.
Could anyone help me to find the problem or the place Zope is hanging
thanks as
P.S.: Exact the same problem occurs when i you another PostgresDA ????
_______________________________________________ Zope-Dev maillist - Zope-Dev@zope.org http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Hi Steve, Immunix Redhat 6.2 Zope 2.3.3 Postgres 7.1.2 I'am running Zope with -M -D and with Stupid_log_file. But i don't find a problem. When Zope hangs, then there is one Thread Running and if i trace this Thread nothing happens. as Steve Spicklemire schrieb:
Hi Andre,
What OS? I've had lots of trouble with Postgres and threads on FreeBSD. Have you tried starting Zope with '-D' to see if threads are an issue?
-steve
Andre Schubert wrote:
Hi all,
I have a problem with my Zope, he hangs unexpectly if i view a special Method which generates Diagrams with data from a PostgresDB. The data are selected by a timespan( default is 24 Hours ). The Method works as descripted bellow:
First when i call foo, then the HTML-Code is rendered with some images-tags, which are generated by selects. The image tags are calling the method foo which returns image data.
If i want my diagrams from 2001-06-01 5:00 to 2001-06-01 12:05 everything works fine. If i want my diagrams from 2001-06-01 5:00 to 2001-06-01 12:10 Zope hangs, no exception no log entry, Zope only hangs. If i want my diagrams from 2001-06-01 5:05 to 2001-06-01 12:10 which is the same timespan as example 1 Zope hangs too, no exception no log entry, Zope only hangs.
If i view the postgres logs the nothing happens.
Could anyone help me to find the problem or the place Zope is hanging
thanks as
P.S.: Exact the same problem occurs when i you another PostgresDA ????
_______________________________________________ Zope-Dev maillist - Zope-Dev@zope.org http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
_______________________________________________ Zope-Dev maillist - Zope-Dev@zope.org http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
I've had this problem as well, although I changed from ZPopPy to psycopg0.99.4 which solved the problem. What I found in REdhat Linux 7.1, where the ps -ef command now queries more info from its children, I finally saw the status of my dbms threads. The Zope hanging maybe wasnt zope directly. It still translated requests BUT I saw in ps -ef: postgresql db01 UPDATE waiting..... This is where the hang is. Several emails from Dieter just confused me more. Something about Zope not having imlicit commits on transactions, so you had to make sure a <dtml-call transaction().commit()> was placed somehwere. This seemed to solve some problems at the time for me although I got alot of : Warning: COMMIT, No transacion in progress Hope I confused you a bit more. Maybe we can get somewhere eventaully ;_) Paz -----Original Message----- From: zope-dev-admin@zope.org [mailto:zope-dev-admin@zope.org]On Behalf Of Andre Schubert Sent: Thursday, July 12, 2001 2:48 PM To: steve@spvi.com Cc: zope Subject: Re: [Zope-dev] Curiously Zope Hanging Hi Steve, Immunix Redhat 6.2 Zope 2.3.3 Postgres 7.1.2 I'am running Zope with -M -D and with Stupid_log_file. But i don't find a problem. When Zope hangs, then there is one Thread Running and if i trace this Thread nothing happens. as Steve Spicklemire schrieb:
Hi Andre,
What OS? I've had lots of trouble with Postgres and threads on FreeBSD. Have you tried starting Zope with '-D' to see if threads are an issue?
-steve
Andre Schubert wrote:
Hi all,
I have a problem with my Zope, he hangs unexpectly if i view a special Method which generates Diagrams with data from a PostgresDB. The data are selected by a timespan( default is 24 Hours ). The Method works as descripted bellow:
First when i call foo, then the HTML-Code is rendered with some images-tags, which are generated by selects. The image tags are calling the method foo which returns image data.
If i want my diagrams from 2001-06-01 5:00 to 2001-06-01 12:05 everything works fine. If i want my diagrams from 2001-06-01 5:00 to 2001-06-01 12:10 Zope hangs, no exception no log entry, Zope only hangs. If i want my diagrams from 2001-06-01 5:05 to 2001-06-01 12:10 which is the same timespan as example 1 Zope hangs too, no exception no log entry, Zope only hangs.
If i view the postgres logs the nothing happens.
Could anyone help me to find the problem or the place Zope is hanging
thanks as
P.S.: Exact the same problem occurs when i you another PostgresDA ????
_______________________________________________ Zope-Dev maillist - Zope-Dev@zope.org http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
_______________________________________________ Zope-Dev maillist - Zope-Dev@zope.org http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
_______________________________________________ Zope-Dev maillist - Zope-Dev@zope.org http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
On 12 Jul 2001 15:20:16 +0200, Paul Zwarts wrote:
I've had this problem as well, although I changed from ZPopPy to psycopg0.99.4 which solved the problem. What I found in REdhat Linux 7.1, where the ps -ef command now queries more info from its children, I finally saw the status of my dbms threads. The Zope hanging maybe wasnt zope directly. It still translated requests BUT I saw in ps -ef:
postgresql db01 UPDATE waiting.....
This is where the hang is. Several emails from Dieter just confused me more. Something about Zope not having imlicit commits on transactions, so you had to make sure a <dtml-call transaction().commit()> was placed somehwere. This seemed to solve some problems at the time for me although I got alot of :
Warning: COMMIT, No transacion in progress
never, never, never do that with psycopg. psycopg cooperates with zope (that *does* commit on transactions) and has real transaction control. with zope+psycopg you'll get a commit (or abort) just at the end of the requested page. ciao, federico -- Federico Di Gregorio MIXAD LIVE Chief of Research & Technology fog@mixadlive.com Debian GNU/Linux Developer & Italian Press Contact fog@debian.org All'inizio ho scritto un programma proprietario, in esclusiva per il cliente; e mi ha succhiato un pezzo di anima. -- Alessandro Rubini
Yes, thanks for mentioning that Frederico. I _should_ have said thats what I used in PoPy. I dont use it anymore with your product. : ), but that doesnt mean I'm any wiser for this. But *magic* is a highly used term in programming these days, so I'm not worried too much. At least I dont have unhappy customers anymore. Paz -----Original Message----- From: Federico Di Gregorio [mailto:fog@mixadlive.com] Sent: Thursday, July 12, 2001 3:30 PM To: Paul Zwarts Cc: Andre Schubert; steve@spvi.com; zope Subject: RE: [Zope-dev] Curiously Zope Hanging On 12 Jul 2001 15:20:16 +0200, Paul Zwarts wrote:
I've had this problem as well, although I changed from ZPopPy to psycopg0.99.4 which solved the problem. What I found in REdhat Linux 7.1, where the ps -ef command now queries more info from its children, I finally saw the status of my dbms threads. The Zope hanging maybe wasnt zope directly. It still translated requests BUT I saw in ps -ef:
postgresql db01 UPDATE waiting.....
This is where the hang is. Several emails from Dieter just confused me more. Something about Zope not having imlicit commits on transactions, so you had to make sure a <dtml-call transaction().commit()> was placed somehwere. This seemed to solve some problems at the time for me although I got alot of :
Warning: COMMIT, No transacion in progress
never, never, never do that with psycopg. psycopg cooperates with zope (that *does* commit on transactions) and has real transaction control. with zope+psycopg you'll get a commit (or abort) just at the end of the requested page. ciao, federico -- Federico Di Gregorio MIXAD LIVE Chief of Research & Technology fog@mixadlive.com Debian GNU/Linux Developer & Italian Press Contact fog@debian.org All'inizio ho scritto un programma proprietario, in esclusiva per il cliente; e mi ha succhiato un pezzo di anima. -- Alessandro Rubini
Well, the good news is you have a reproducable symptom! Some suggestions: 1) Try the quer(y/ies) that cause the hang separately to make sure they return OK. 2) Create a Python script/Tiny table/Gadfly query that returns data that looks just like the result of your postgresql query to test the rest of your system. (these two just isolate the problem to postgres or Zope) 3) Get out the debugger and step through the publisher to see where it's hanging.. (in -D mode you can also 'print' in python and the results will appear on stdout of the 'start -D' process. 4) Post some real code so we can see what you're really up to (!?) -steve Andre Schubert wrote:
Hi Steve,
Immunix Redhat 6.2 Zope 2.3.3 Postgres 7.1.2
I'am running Zope with -M -D and with Stupid_log_file. But i don't find a problem. When Zope hangs, then there is one Thread Running and if i trace this Thread nothing happens.
as
Steve Spicklemire schrieb:
Hi Andre,
What OS? I've had lots of trouble with Postgres and threads on FreeBSD. Have you tried starting Zope with '-D' to see if threads are an issue?
-steve
Andre Schubert wrote:
Hi all,
I have a problem with my Zope, he hangs unexpectly if i view a special Method which generates Diagrams with data from a PostgresDB. The data are selected by a timespan( default is 24 Hours ). The Method works as descripted bellow:
First when i call foo, then the HTML-Code is rendered with some images-tags, which are generated by selects. The image tags are calling the method foo which returns image data.
If i want my diagrams from 2001-06-01 5:00 to 2001-06-01 12:05 everything works fine. If i want my diagrams from 2001-06-01 5:00 to 2001-06-01 12:10 Zope hangs, no exception no log entry, Zope only hangs. If i want my diagrams from 2001-06-01 5:05 to 2001-06-01 12:10 which is the same timespan as example 1 Zope hangs too, no exception no log entry, Zope only hangs.
If i view the postgres logs the nothing happens.
Could anyone help me to find the problem or the place Zope is hanging
thanks as
P.S.: Exact the same problem occurs when i you another PostgresDA ????
_______________________________________________ Zope-Dev maillist - Zope-Dev@zope.org http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
_______________________________________________ Zope-Dev maillist - Zope-Dev@zope.org http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
No, the problem is not reproduceable, because if move the timespan 5 minutes earlier then Zope crashes. And thats the problem. If have a select which selects data of a given timespan. The number of rows is equal, but the start and end is changing. The queries itself are running withoput problems in my testscripts. The next is that there are over 23 Million of rows in the DB and there is an btree index of two collumns a and b. And now comes the curiousity. If i call my diagrams in the order that a is the same and b is changing everything works well and there are absolutely no hangs, but if i call my diagrams the other way that a is changing and b is the same then Zope works if i select data from 2001-06-01 5:00 to 2001-06-20 12:05 and Zope hangs if i select data from 2001-06-01 5:00 to 2001-06-20 12:10 or from 2001-06-01 5:05 to 2001-06-20 12:10 I hope you understand my explanations in my bad german-english. as Steve Spicklemire schrieb:
Well, the good news is you have a reproducable symptom!
Some suggestions:
1) Try the quer(y/ies) that cause the hang separately to make sure they return OK.
2) Create a Python script/Tiny table/Gadfly query that returns data that looks just like the result of your postgresql query to test the rest of your system. (these two just isolate the problem to postgres or Zope)
3) Get out the debugger and step through the publisher to see where it's hanging.. (in -D mode you can also 'print' in python and the results will appear on stdout of the 'start -D' process.
4) Post some real code so we can see what you're really up to (!?)
-steve
Andre Schubert wrote:
Hi Steve,
Immunix Redhat 6.2 Zope 2.3.3 Postgres 7.1.2
I'am running Zope with -M -D and with Stupid_log_file. But i don't find a problem. When Zope hangs, then there is one Thread Running and if i trace this Thread nothing happens.
as
Steve Spicklemire schrieb:
Hi Andre,
What OS? I've had lots of trouble with Postgres and threads on FreeBSD. Have you tried starting Zope with '-D' to see if threads are an issue?
-steve
Andre Schubert wrote:
Hi all,
I have a problem with my Zope, he hangs unexpectly if i view a special Method which generates Diagrams with data from a PostgresDB. The data are selected by a timespan( default is 24 Hours ). The Method works as descripted bellow:
First when i call foo, then the HTML-Code is rendered with some images-tags, which are generated by selects. The image tags are calling the method foo which returns image data.
If i want my diagrams from 2001-06-01 5:00 to 2001-06-01 12:05 everything works fine. If i want my diagrams from 2001-06-01 5:00 to 2001-06-01 12:10 Zope hangs, no exception no log entry, Zope only hangs. If i want my diagrams from 2001-06-01 5:05 to 2001-06-01 12:10 which is the same timespan as example 1 Zope hangs too, no exception no log entry, Zope only hangs.
If i view the postgres logs the nothing happens.
Could anyone help me to find the problem or the place Zope is hanging
thanks as
P.S.: Exact the same problem occurs when i you another PostgresDA ????
_______________________________________________ Zope-Dev maillist - Zope-Dev@zope.org http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
_______________________________________________ Zope-Dev maillist - Zope-Dev@zope.org http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
_______________________________________________ Zope-Dev maillist - Zope-Dev@zope.org http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Hi Andre, Andre Schubert wrote:
No, the problem is not reproduceable, because if move the timespan 5 minutes earlier then Zope crashes. And thats the problem.
Hmm.. my point was only that if you can *predict* correctly when Zope will hang.. then it is at least 'reproducable'.
If i call my diagrams in the order that a is the same and b is changing everything works well and there are absolutely no hangs, but if i call my diagrams the other way that a is changing and b is the same then Zope works if i select data from 2001-06-01 5:00 to 2001-06-20 12:05 and Zope hangs if i select data from 2001-06-01 5:00 to 2001-06-20 12:10 or from 2001-06-01 5:05 to 2001-06-20 12:10
I hope you understand my explanations in my bad german-english.
I think I get the basic picture... but
as
Steve Spicklemire schrieb:
Well, the good news is you have a reproducable symptom!
Ah, the common paradigm. someone TOLD me that smoking cigarettes wiht ceral and milk will make me barf, and I can assume that to be so. But when i do indeed barf, do I come satisfied with that or now question if that it had to do with te spoon or the bowl? Paz -----Original Message----- From: zope-dev-admin@zope.org [mailto:zope-dev-admin@zope.org]On Behalf Of Steve Spicklemire Sent: Thursday, July 12, 2001 4:17 PM To: Andre Schubert Cc: zope Subject: Re: [Zope-dev] Curiously Zope Hanging Hi Andre, Andre Schubert wrote:
No, the problem is not reproduceable, because if move the timespan 5
minutes earlier then
Zope crashes. And thats the problem.
Hmm.. my point was only that if you can *predict* correctly when Zope will hang.. then it is at least 'reproducable'.
If i call my diagrams in the order that a is the same and b is changing everything works well and there are absolutely no hangs, but if i call my diagrams the other way that a is changing and b is the same then Zope works if i select data from 2001-06-01 5:00 to 2001-06-20 12:05 and Zope hangs if i select data from 2001-06-01 5:00 to 2001-06-20 12:10 or from 2001-06-01 5:05 to 2001-06-20 12:10
I hope you understand my explanations in my bad german-english.
I think I get the basic picture... but
as
Steve Spicklemire schrieb:
Well, the good news is you have a reproducable symptom!
_______________________________________________ Zope-Dev maillist - Zope-Dev@zope.org http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Sorry.. got distracted and forgot where I was!
I think I get the basic picture... but
I think maybe we need more details of your system to be of any more help.. -steve
as
Steve Spicklemire schrieb:
Well, the good news is you have a reproducable symptom!
_______________________________________________ Zope-Dev maillist - Zope-Dev@zope.org http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Hi, Ok, we( my SysAdmin and i ) have found the problem of hanging. After hours of searching in the python Sources of all the Products which are involved we have nothing found. At this point my SysAdmin has the idea to trace the python processes with gdb. After this we could see that Zope was running somewhare in the gdchart.so module. After an update of the gdchart.so the problem doesn't occur anymore. I doesn't know enough to work with gdb, but if my SysAdmin were not able to work with gdb so very well, i never have found the point were Zope runs into another universe :) thanks as Steve Spicklemire schrieb:
Sorry.. got distracted and forgot where I was!
I think I get the basic picture... but
I think maybe we need more details of your system to be of any more help..
-steve
as
Steve Spicklemire schrieb:
Well, the good news is you have a reproducable symptom!
_______________________________________________ Zope-Dev maillist - Zope-Dev@zope.org http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
_______________________________________________ Zope-Dev maillist - Zope-Dev@zope.org http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Steve Spicklemire writes:
What OS? I've had lots of trouble with Postgres and threads on FreeBSD. Have you tried starting Zope with '-D' to see if threads are an issue? Maybe in the stone age "-D" had disabled threading.
All Zope versions I know of (from 2.1.6 on) were multi-threaded even in debug mode. Dieter
participants (5)
-
Andre Schubert -
Dieter Maurer -
Federico Di Gregorio -
Paul Zwarts -
Steve Spicklemire