I'm curious as to what is holding up Zope 2.5.1? 2.5.1b1 has been out for quite a while now (in Zope time). --andy.
We are trying to get to the bottom of a few straggling instability reports, so we're planning to go ahead with a b2 as soon as we've either a) figured out and fixed them b) figured them out and found it wasn't a Zope core problem or c) decide that we can't make enough progress in a reasonable time to continue holding up the release. Brian Lloyd brian@zope.com V.P. Engineering 540.361.1716 Zope Corporation http://www.zope.com
-----Original Message----- From: zope-dev-admin@zope.org [mailto:zope-dev-admin@zope.org]On Behalf Of Andrew Sydelko Sent: Wednesday, March 13, 2002 10:44 AM To: zope-dev@zope.org Subject: [Zope-dev] where is Zope 2.5.1?
I'm curious as to what is holding up Zope 2.5.1? 2.5.1b1 has been out for quite a while now (in Zope time).
--andy.
_______________________________________________ Zope-Dev maillist - Zope-Dev@zope.org http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
On Wed, 2002-03-13 at 13:03, Brian Lloyd wrote:
We are trying to get to the bottom of a few straggling instability reports, so we're planning to go ahead with a b2 as soon as we've either a) figured out and fixed them b) figured them out and found it wasn't a Zope core problem or c) decide that we can't make enough progress in a reasonable time to continue holding up the release.
Is there anything that we with unstable Zopes can do to help? -- Ideas don't stay in some minds very long because they don't like solitary confinement.
We are trying to get to the bottom of a few straggling instability reports, so we're planning to go ahead with a b2 as soon as we've either a) figured out and fixed them b) figured them out and found it wasn't a Zope core problem or c) decide that we can't make enough progress in a reasonable time to continue holding up the release.
Is there anything that we with unstable Zopes can do to help?
The best way to help is to help get this (these) down to a minimal, reproducable test case. Getting there can be tricky, but there are some things that we can try to find out: - In the logs, is there any pattern to what is being accessed at the time of the crash? If there is a particular object or objects that seems to often be the last accessed before a crash, we can start looking at what PythonScripts the object uses. - Use the "big M" log to try to narrow down exactly what is happening at the time of the crash. - Ensure that you are getting absolutely no "python scripts need to be recompiled" messages - Absolutely eliminate SQL db access as a cause (it sounds like we have proof of this now) Brian Lloyd brian@zope.com V.P. Engineering 540.361.1716 Zope Corporation http://www.zope.com
On Wed, 2002-03-13 at 14:04, Brian Lloyd wrote:
The best way to help is to help get this (these) down to a minimal, reproducable test case.
The problem is, as far as I could check, the crashes all happen inside the gc, which runs orthogonal to the requests, so getting a reproduceable test case is really hard.
Getting there can be tricky, but there are some things that we can try to find out:
- In the logs, is there any pattern to what is being accessed at the time of the crash? If there is a particular object or objects that seems to often be the last accessed before a crash, we can start looking at what PythonScripts the object uses.
No, crashes happen all over the map (most of the site runs the same python scripts for authentication and inside ZClass instances)
- Use the "big M" log to try to narrow down exactly what is happening at the time of the crash.
Will do, but since the crashes happen all over the map, I don't think we'll be able to get much out of it
- Ensure that you are getting absolutely no "python scripts need to be recompiled" messages
Check!
- Absolutely eliminate SQL db access as a cause (it sounds like we have proof of this now)
Check! As someone else mentioned on this list, maybe if we could force the gc to collect alligned with the requests (say, in the first phase of the two-phase-commit transaction engine, or after the second phase) we could get the crashes to be reproduceable, or at least more localized. Also, as I pointed out before, since '-t 1' solves the crashes, if we could incrementally reduce the contention area around the code, by putting and successively removing locks around certain sections, we might be able to track it down. The problem is, I don't know enough about Zope code to know how to do any of those things, and I suspect the other folks with crashes are in the same situation. Cheers, Leo -- Ideas don't stay in some minds very long because they don't like solitary confinement.
On 13 Mar 2002 16:44:25 -0300, Leonardo Rochael Almeida <leo@hiper.com.br> wrote:
The problem is, as far as I could check, the crashes all happen inside the gc, which runs orthogonal to the requests, so getting a reproduceable test case is really hard.
Thinking aloud.... If I remember correctly (but its been a while since I looked at the python gc) it is possible to manually force a gc sweep. It may (or may not ;-) be easier to spot a pattern if you force a sweep after every request Toby Dickenson tdickenson@geminidataloggers.com
On Wed, 2002-03-13 at 12:04, Brian Lloyd wrote:
- Absolutely eliminate SQL db access as a cause (it sounds like we have proof of this now)
This sounds like it is not specific to any DA. Is that the case? -- Andy Dustman PGP: 0x930B8AB6 @ .net http://dustman.net/andy You can have my keys when you pry them from my dead, cold neurons.
- Absolutely eliminate SQL db access as a cause (it sounds like we have proof of this now)
This sounds like it is not specific to any DA. Is that the case?
The only one I know of is the MySQL DA, but what I was getting at here was that eliminating ANY sql db access lets us discard the possibility of a DA problem and focus on other possibilities (IOW, is this really in Zope, or is this related to use or misuse of database libraries, which can vary widely in their thread support (or lack thereof). Brian Lloyd brian@zope.com V.P. Engineering 540.361.1716 Zope Corporation http://www.zope.com
"Brian Lloyd" <brian@zope.com> writes:
We are trying to get to the bottom of a few straggling instability reports, so we're planning to go ahead with
Hi Brian, I started with 2.5.1b1 today and have problems with our "one central index_html" approach. It seems that in 2.5.1b1 object lookup doesn't start at the current context when an object is used from another already acquired one. I couldn't find anything about this, so I hope it's something new for you. Example: / index_html (index_html uses method content) content /folder1 content /folder1/subfolder1 content When accessing /folder1 or /folder1/subfolder1 always content from the root folder is used. Do we have a stupid mistake or is there something wrong in 2.5.1b1? The root folder is "made root" by a SiteRoot object and we have a SiteRoot also in Zopes root folder. I tried also with the SiteRoots removed and the behaviour was the same. Regards, Frank
Frank Tegtmeyer wrote:
"Brian Lloyd" <brian@zope.com> writes:
We are trying to get to the bottom of a few straggling instability reports, so we're planning to go ahead with
I started with 2.5.1b1 today and have problems with our "one central index_html" approach.
That would be really really bad for many of us..
It seems that in 2.5.1b1 object lookup doesn't start at the current context when an object is used from another already acquired one.
I couldn't find anything about this, so I hope it's something new for you.
Example:
/ index_html (index_html uses method content) content
/folder1 content /folder1/subfolder1 content
When accessing /folder1 or /folder1/subfolder1 always content from the root folder is used.
Do we have a stupid mistake or is there something wrong in 2.5.1b1? The root folder is "made root" by a SiteRoot object and we have a SiteRoot also in Zopes root folder. I tried also with the SiteRoots removed and the behaviour was the same.
I can't reproduce this myself. Are you using DTML, PageTemplates, something else? I've tested this with Zope 2.5.1b1 with 'index_html' in a subfolder alpha, and also a 'content' there which is used by the index_html. Folder beta is inside alpha and only contains content. That works just fine; I see the beta content when I go to /alpha/beta Regards, Martijn
Martijn Faassen <faassen@vet.uu.nl> writes:
I can't reproduce this myself. Are you using DTML, PageTemplates, something else?
I tried with 2.5.0 also and had the same effect. I assume there is some Product interference - I will try to eliminate the one. Maybe it's a patched version of ZSyncer. I will report here. Thanks for taking the time for a check. Regards, Frank
Frank Tegtmeyer <fte@lightwerk.com> writes:
Thanks for taking the time for a check.
I completely made a fool of myself - I was falling into the DTML-Document/DTML-method trap. The central index_html was created as DTML document .. Sorry for stealing your time. Regards, Frank
participants (7)
-
Andrew Sydelko -
Andy Dustman -
Brian Lloyd -
Frank Tegtmeyer -
Leonardo Rochael Almeida -
Martijn Faassen -
Toby Dickenson