[Zope] Strange Zope behavior/Instability (Zope going down)

Harald Ragger h.ragger@aon.at
Mon, 5 Jun 2000 12:27:56 +0200


Jason, Rob:

Ive just seen your mails, and thought uuups!
One of my customers is using zope (2.1.4; ms cluster server; nt4 basis).
Zope has been running fine for more than three months, but on 1st of June it
crashed, and didn't came up again (no response from server even the zope
services seemed to be up and running). every minute or so, we got the
following message in the event-view: restarting zope.
The only chance I saw to bring Zope up again, was to reinstall the whole
thing, and use the backed up Data.fs file.
So far so good, its now running again, all data is ok, nothing lost.
But:
whats the reason for this? i simply have no idea (logs didnt show anything
relevant as far as i understand). why i thought uups, was because of the
same time this happend to me as to you (you also use 2.1.4). could it be a
problem with 2.1.4? should we consider to upgrade to 2.1.6?

regards
Harald

----- Original Message -----
From: "Jason Spisak" <444@hiretechs.com>
To: <rsporleder@openave.com>
Cc: <zope@zope.org>
Sent: Friday, June 02, 2000 9:15 PM
Subject: Re: [Zope] Strange Zope behavior/Instability (Zope going down)


> Rob Sporleder writes:
>
> > The shell was on my local machine...
> >
>
> That's the same as tryinga browser for network purposes.  Can you try
> bringing up a shell on the server next time and try a wget
> http://localhost:8080, and see if it returns anything.  If so, the Zope is
> fine and it's that other stuff, like network cards etc...
>
> > BigBrother is the monitoring software we use. The client is installed on
the
> > same server as Zope.
> >
> > When viewing the log files there were no connections made by BigBrother
> > (checking for http connections). However, there were many hits from
outside
> > IP's.
> >
> > Thanks,
> > Rob
> >
> > -----Original Message-----
> > From: Jason Spisak [mailto:444@hiretechs.com]
> > Sent: Friday, June 02, 2000 10:17 AM
> > To: rsporleder@openave.com
> > Cc: zope@zope.org
> > Subject: Re: [Zope] Strange Zope behavior/Instability (Zope going down)
> >
> >
> > Rob Sporleder writes:
> >
> > > It was the command line within the shell.
> >
> > Was it the shell on the 'server' serving zope or a shell on your local
> > admin machine?
> >
> > >Actually, I've found something
> > > that's interesting...
> > >
> > > The system clock is an hour slow.
> >
> > They get behind easily if your not using an time server somewhere.
> >
> > >The logs are written 6 hours ahead.
> >
> > I have no idea on that.
> >
> > >I
> > > greped the log file for BigBrother and found an hour gap with no
> > BigBrother
> >
> > Is BigBrother the Zope server?
> >
> > > entries from 06:37:53 and 07:40:23, roughly the time that the site
seemed
> > to
> > > go down. However, during this time there were hundreds of successful
hits
> > to
> > > the site.
> >
> > What told you there were successful hits? The Zope log?  If
understanding
> > you, you are seeing confilcting things in 2 logs. One log says there was
> > successfull hit, and the other shows nothing for that time.  Is this
close?
> >
> > >
> > > Rob Sporleder writes:
> > >
> > > > All of the python z2.py processes are still running. I haven't
checked
> > if
> > > I
> > > > can get to it using http://localhost. The server is offsite.
However, I
> > > did
> > > > try an http get from the command line and it did not respond.
> > > >
> > >
> > > Was it the command line on the server?
> > > from the server shell:
> > >
> > > $>wget http://localhost:8080
> > >
> > > I'm trying to narrow it down to the real culprit.  We can't be sure
it's
> > > Zope and not the DNS/Machine/Routing/Firewall/ or anything else.
> > >
> > > > -----Original Message-----
> > > > From: Jason Spisak [mailto:444@hiretechs.com]
> > > > Sent: Wednesday, May 31, 2000 1:13 PM
> > > > To: rsporleder@openave.com
> > > > Cc: zope@zope.org
> > > > Subject: Re: [Zope] Strange Zope behavior/Instability (Zope going
down)
> > > >
> > > >
> > > > Rob Sporleder:
> > > >
> > > > > I received a server not responding error. We lost connectivity
twice
> > on
> > > > > Friday as well. I setup a script to restart the server every X
minutes
> > > so
> > > > we
> > > > > wouldn't have to worry about it over the weekend. I removed the
> > cronjob
> > > on
> > > > > Tuesday morning and it was fine until early Wednesday morning when
it
> > > went
> > > > > down three times in 30 minutes.
> > > > >
> > > > > Thanks,
> > > > > Rob
> > > > >
> > > >
> > > > Wow. Ugly.  Are the Zope processes still up after you've lost
> > > connectivity?
> > > >  If so, can you get a browser on the machine running zope to access
it?
> > > > http://localhost:8080, or whatever port your running on.
> > > >
> > > > > -----Original Message-----
> > > > > From: zope-admin@zope.org [mailto:zope-admin@zope.org]On Behalf Of
> > Jason
> > > > > Spisak
> > > > > Sent: Wednesday, May 31, 2000 12:10 PM
> > > > > To: rsporleder@openave.com
> > > > > Cc: zope@zope.org
> > > > > Subject: Re: [Zope] Strange Zope behavior/Instability
> > > > >
> > > > >
> > > > > Rob Sporleder:
> > > > >
> > > > > > For reasons unknown we lost http connectivity to our Zope server
> > three
> > > > > times
> > > > > > last night.
> > > > >
> > > > > When you say lost connectivity, do you mean the browsers gave you
back
> > a
> > > > > 'Server Not Resonding' message, or was is as if Zope was just
spinning
> > > > it's
> > > > > wheels?  If it was the latter, how long did you wait to see if you
did
> > > get
> > > > > a response? 1 minute, 10, 30?
> > > > >
> > > > > >I've checked the http logs and, as I suspected, didn't find
> > > > > > anything unusual around the time we lost connectivity. The
Python
> > > > > processes
> > > > > > are still running and everything looks normal except for the
> > > > connectivity
> > > > > > problem. Does anybody have any idea what might be causing this?
I
> > > > haven't
> > > > > > found anything.
> > > > > >
> > > > >
> > > > > This happened to me, but it caused a single process to chew CPU.
> > Since
> > > > you
> > > > > noticed no such chewing, I'll bet it's not the DTML decapitation
bug.
> > > > >
> > > > > > Here are some specifics about our setup...
> > > > > >
> > > > > > version of python:
> > > > > > 1.5.2
> > > > > >
> > > > > > operating system:
> > > > > > Linux 2.2.12-20smp (Redhat 6.1)
> > > > > >
> > > > > > services running on machine:
> > > > > > MySQL
> > > > > > 2 instances of Zope
> > > > > > Python
> > > > > >
> > > > > > machine specifics:
> > > > > >
> > > > > > CPU: 0.04
> > > > > > MEM: 31M of 512M
> > > > > > Swap: 528688K free
> > > > > > Disk Space: GB's available on all partitions
> > > > > > Hardware: 598 Mhz Pentium III, 4 17.4 GB SCSI hard disks
> > > > > >
> > > > > > version of Zope:
> > > > > > 2.1.4
> > > > > >
> > > >
> > > > Jason Spisak
> > > > CIO
> > > > HireTechs.com
> > > > 6151 West Century Boulevard
> > > > Suite 900
> > > > Los Angeles, CA 90045
> > > > P. 310.665.3444
> > > > F. 310.665.3544
> > > >
> > > > Under US Code Title 47, Sec.227(b)(1)(C), Sec.227(a)(2)(B) This
email
> > > > address may not be added to any commercial mail list with out my
> > > > permission.  Violation of my privacy with advertising or SPAM will
> > > > result in a suit for a MINIMUM of $500 damages/incident, $1500 for
> > > > repeats.
> > > >
> > >
> > >
> > > Jason Spisak
> > > CIO
> > > HireTechs.com
> > > 6151 West Century Boulevard
> > > Suite 900
> > > Los Angeles, CA 90045
> > > P. 310.665.3444
> > > F. 310.665.3544
> > >
> > > Under US Code Title 47, Sec.227(b)(1)(C), Sec.227(a)(2)(B) This email
> > > address may not be added to any commercial mail list with out my
> > > permission.  Violation of my privacy with advertising or SPAM will
> > > result in a suit for a MINIMUM of $500 damages/incident, $1500 for
> > > repeats.
> > >
> >
> >
> > Jason Spisak
> > CIO
> > HireTechs.com
> > 6151 West Century Boulevard
> > Suite 900
> > Los Angeles, CA 90045
> > P. 310.665.3444
> > F. 310.665.3544
> >
> > Under US Code Title 47, Sec.227(b)(1)(C), Sec.227(a)(2)(B) This email
> > address may not be added to any commercial mail list with out my
> > permission.  Violation of my privacy with advertising or SPAM will
> > result in a suit for a MINIMUM of $500 damages/incident, $1500 for
> > repeats.
> >
>
>
> Jason Spisak
> CIO
> HireTechs.com
> 6151 West Century Boulevard
> Suite 900
> Los Angeles, CA 90045
> P. 310.665.3444
> F. 310.665.3544
>
> Under US Code Title 47, Sec.227(b)(1)(C), Sec.227(a)(2)(B) This email
> address may not be added to any commercial mail list with out my
> permission.  Violation of my privacy with advertising or SPAM will
> result in a suit for a MINIMUM of $500 damages/incident, $1500 for
> repeats.
>
> _______________________________________________
> Zope maillist  -  Zope@zope.org
> http://lists.zope.org/mailman/listinfo/zope
> **   No cross posts or HTML encoding!  **
> (Related lists -
>  http://lists.zope.org/mailman/listinfo/zope-announce
>  http://lists.zope.org/mailman/listinfo/zope-dev )
>
>