[Zope-Dev] Zope 2.1.6 Memory issue

[Jason Spisak]

Shane Hathaway writes:

> Jason Spisak wrote:
> > 
> > Shane Hathaway writes:
> > 
> > I had to restart Zope. I was about to start swapping, and now everyone's a
> > lunch.
> > 
> > It's so weird.  Even though there is really no one on it that memory is
> > just flying out the window.
> > 
> > > Jason Spisak wrote:
> > > >
> > > > Shane Hathaway writes:
> > > >
> > > > Okay, here's the output.  (BTW is was trying manage_debug without the
> > > > Control_Panel.  That was not intelligent;)
> > > >
> > > > Class           May 22, 2000 4:21 am    May 22, 2000 4:22 am    Delta
> > > > OIBTree.Bucket  7132                    8135                    +1003
> > > > IOBTree.BTree   2570                    2827                    +257
> > > > BTree.BTree     1028                    1105                    +77
> > > > IIBTree.Bucket  4590                    4619                    +29
> > >
> > > Since you say you are not using any DA's, the culprit must be
> > > ZCatalog.  What happens when you minimize the memory cache (setting the
> > > limit to 3 seconds)?  Do the OIBTree.Bucket objects get unloaded?
> > >
> > > Shane
> > 
> > How would I tell if they get unloaded?  I am new to the manage_debug BTW.
> > I set the Cache Parameters target time between accesses to 3.  What am I
> > looking for number-wise?
> 
> I studied your debug screens a little more and realized that the
> handling of BTree, etc. is probably in order.  The refcount is indeed
> decreasing--I think you just happened to hit a spike.
> 
> You must have a large site.  

300,000 + objects

>I'm guessing that you have a lot of
> objects that get cataloged.  

Yep. That's why I have the machine I do, though.

>In order for them to be cataloged, they
> have to be loaded into memory then unloaded.
> 

I see.

> Go to Control Panel -> Database Management -> Flush Cache and click
> "minimize".  Then go to Control Panel -> Database Management -> Cache
> Parameters.  After a minimize operation, the "Total number of objects
> in all of the caches combined" should be relatively low (< 1000), as
> well as your system memory usage.  Is that the case?

No.  After the 'minimize' I now have 15501 objects in cache combined.  And
the free command shows less memory than before the minimize command.
As Wyle E. Coyote would say...Yipe. :o

Jason Spisak
CIO
HireTechs.com
6151 West Century Boulevard
Suite 900
Los Angeles, CA 90045
P. 310.665.3444
F. 310.665.3544

Under US Code Title 47, Sec.227(b)(1)(C), Sec.227(a)(2)(B) This email
address may not be added to any commercial mail list with out my
permission.  Violation of my privacy with advertising or SPAM will
result in a suit for a MINIMUM of $500 damages/incident, $1500 for
repeats.