- Zope - Zope lists

Zope 2.7.3 + Apelib 1.0 - Intermittent data loss in acl_users obj
by Chris Kratz 07 Jan '05

07 Jan '05

Hello all, We've been using Apelib with Zope 2.7.3 for several weeks on a production site. We've been having problems with password changes disapearing intermittently from one day to the next, and whole user accounts being lost periodically. Up until today, we thought it was a bug in our own code. After being able to reproduce the problem outside of our code (using the zmi), we started looking at Zope and Apelib. We have come to the conclusion that a standard acl_users folder is not always correctly persisted when using apelib. Whether or not we are right, the following is how we understand things to be working at this point as well as an ugly hack that seems to fix the problem. We are using the file system persistence method of apelib for our test bed. Using the file system persistence and grep, it is a very simple procedure to add a user, change a password through the zope zmi and verify that the changes to acl_users were persisted by inspecting the file on the file system. There is no pattern, but almost always after several changes to a password or adding several users, the changes stopped being persisted to the file. Stopping and starting zope at any point from then on loses those user accounts or password changes that were done after the persistence stopped happening. We verified that the objects are correctly changed in memory, because subsequent use returns the modified data. Also, updating the properties on an acl_users folder (going to Properties tab and clicking Save changes) causes all changes to be written out including password changes and user account additions and removals. We are no experts on this code, but it appears that the serializing code in apelib only is inspecting the _p_changed flag on the user folder itself and not on the individual user objects persisted within. In a standard zodb, it appears that every user object is persisted separately. So, a change to the user object only marks that user object as changed, not acl_users. But in apelib, the acl_users folder is persisted as a whole with all user objects as the contents. With a standard ZODB, any updates to user objects are persisted at the user object level. The same thing appears to be happening with apelib except that it appears that apelib when persisting objects only examines the acl_users folder and none of the user objects for changes. It may be a red herring, but by adding self._p_changed=1 to _doAddUser, _doChangeUser and _doDelUsers in class UserFolder, we were no longer able to break it (ie changes were always written to file). Since apelib treats a user folder and all it's user objects as a single entity on the file system, this seems to address the problem. What's even more troubling is mixing this issue with multiple threads which caused all kinds of authentication errors when creating new accounts. We are wondering if anyone else has run into a simliar issue, and/or whether there is a better way to solve this then to modify User.py. It seems like the better approach would be to modify apelib, but we haven't been successfull up till now. -Chris

1 0

Zope.org Doc team needs some help
by Mark Pratt 07 Jan '05

07 Jan '05

Hi, Morten Peterson and I have been working on a new and improved documentation section for Zope.org At this point we need one developer to help us create two very simple link items for Zope.org users. These are for articles and books that are published about Zope. Please go here to read the pdf spec of whats required: http://zope.org/Members/beehive/DocStuff/articlebook.pdf/file_view Cheers, Mark

1 0

calling zpt from a script with options
by Haim Ashkenazi 06 Jan '05

06 Jan '05

Hi forgive me if it's trivial, but I'm a complete zope newbie.... I read in the zope book that if I want to call zpt from a script (in my case, to render errors in a form) I do something like this: -- script: pt = context.body_content s = pt(zerror="This is an error") return s zpt: <i tal:content="options/zerror | default">error</i> -- This works without a problem, but it only shows the "body_content" file. this file is part of a layout (inside a folder) and I want to call the folder as the url, so it will acquire the index_html in an upper directory. I tried changing the "pt" variable to context.index_html and calling "here/index_html/options/zerror" in the template but it didn't show. how can I achieve that? thanx -- Haim

3 4

virtual host monster problem
by johan30＠easynet.be 06 Jan '05

06 Jan '05

hi, I have a question of virtual host monster in combination with a virtual plone site, in combination with an apache site I have an url http://212.100.163.214:8080/help that should be directed to http://212.100.163.214/help : this means that everytime i go to the url or http://212.100.163.214/help , I should arrive to http://212.100.163.214:8080/help , which is a zope site. I have installed vhm in the root folder of http://212.100.163.214:8080 and i have as httpd.conf zope-part : LoadModule proxy_module /usr/lib/apache/1.3/libproxy.so AddModule mod_proxy.c <VirtualHost 212.100.163.214> ServerAdmin johan.boeckx(a)be.easynet.net DocumentRoot /opt/jffnms/htdocs ServerName managedrouters.easynet.be </VirtualHost> <VirtualHost *> ServerName managedrouters.easynet.be/help ServerAdmin johan.boeckx(a)be.easynet.net ServerAlias managedrouters.easynet.be/help ProxyPass / http://212.100/163.214:8080/VirtualHostbase/http/managedrouters.easynet.be:… ProxyPassReverse / http://212.100/163.214:8080/VirtualHostbase/http/managedrouters.easynet.be:… </VirtualHost> Nevertheless, when i try to access http://212.100.163.214/help/ , I see in the logs of apache : [Thu Jan 6 22:53:18 2005] [error] [client 81.188.66.90] File does not exist: /opt/jffnms/htdocs/help , which is the document root of the first site, while i need to arrive on the plone-site. Anybody know what i do wrong ? Greetings, Johan

2 2

User login problem: prefs_users_overview
by Mike Elliott 06 Jan '05

06 Jan '05

OK, I got Zope up and running with the assistance of the mailing list. Thanks guys. I have successfully added a Plone site, but when I tried to create a new user through the web interface I got the following message: You have been registered Site Error This site encountered an error trying to fulfill your request. The errors were: ErrorType ValueError ErrorValue Unable to find prefs_users_overview The URL is http://...ploneSite/join_form Do I need to something else before a Plone site is usable?

1 0

Re: [Zope] New user problems with Solaris 9 Zope
by Mike Elliott 06 Jan '05

06 Jan '05

On Thu, 6 Jan 2005 12:27:04 -0800, Mike Elliott <hbrednek(a)gmail.com> wrote: > > You can probably get past this problem in the short term by > > just deleting that file. > > I'll try it. Thanks. Yes, getting rid of the file (or renaming it, in this case) allows Zope to run. Not unsurprisingly, when I open the ZMI (see, I'm learning the buzzwords already!) the Zope version is listed as 'unreleased version'. I assume there's a way to specify that version file manually.

1 0

New user problems with Solaris 9 Zope
by Mike Elliott 06 Jan '05

06 Jan '05

I've been working on getting Zope running on an Ultra 1 running Solaris 9, with no real success so far. I can apparently compile and install Zope, but when I try to run it I get the following: mre@bonk$ instance/bin/runzope -X port-base=1000 Traceback (most recent call last): File "/opt/Zope-2.7/lib/python/Zope/Startup/run.py", line 50, in ? run() File "/opt/Zope-2.7/lib/python/Zope/Startup/run.py", line 18, in run opts = _setconfig() File "/opt/Zope-2.7/lib/python/Zope/Startup/run.py", line 42, in _setconfig opts.realize(doc="Sorry, no option docs yet.") File "/opt/Zope-2.7/lib/python/zdaemon/zdoptions.py", line 271, in realize self.load_schema() File "/opt/Zope-2.7/lib/python/zdaemon/zdoptions.py", line 312, in load_schema self.schema = ZConfig.loadSchema(self.schemafile) File "/opt/Zope-2.7/lib/python/ZConfig/loader.py", line 37, in loadSchema return SchemaLoader().loadURL(url) File "/opt/Zope-2.7/lib/python/ZConfig/loader.py", line 71, in loadURL return self.loadResource(r) File "/opt/Zope-2.7/lib/python/ZConfig/loader.py", line 137, in loadResource schema = ZConfig.schema.parseResource(resource, self) File "/opt/Zope-2.7/lib/python/ZConfig/schema.py", line 43, in parseResource xml.sax.parse(resource.file, parser) File "/usr/local/lib/python2.3/xml/sax/__init__.py", line 33, in parse parser.parse(source) File "/usr/local/lib/python2.3/xml/sax/expatreader.py", line 107, in parse xmlreader.IncrementalParser.parse(self, source) File "/usr/local/lib/python2.3/xml/sax/xmlreader.py", line 123, in parse self.feed(buffer) File "/usr/local/lib/python2.3/xml/sax/expatreader.py", line 207, in feed self._parser.Parse(data, isFinal) File "/usr/local/lib/python2.3/xml/sax/expatreader.py", line 300, in start_element self._cont_handler.startElement(name, AttributesImpl(attrs)) File "/opt/Zope-2.7/lib/python/ZConfig/schema.py", line 119, in startElement getattr(self, "start_" + name)(attrs) File "/opt/Zope-2.7/lib/python/ZConfig/schema.py", line 306, in start_import src = self._loader.schemaComponentSource(pkg, file) File "/opt/Zope-2.7/lib/python/ZConfig/loader.py", line 154, in schemaComponentSource __import__(package) File "/opt/Zope-2.7/lib/python/ZServer/__init__.py", line 30, in ? ZOPE_VERSION=utils.getZopeVersion() File "/opt/Zope-2.7/lib/python/ZServer/utils.py", line 18, in getZopeVersion return App.version_txt.version_txt() File "/opt/Zope-2.7/lib/python/App/version_txt.py", line 57, in version_txt _prep_version_data() File "/opt/Zope-2.7/lib/python/App/version_txt.py", line 45, in _prep_version_data dict = expr.match(s).groupdict() AttributeError: 'NoneType' object has no attribute 'groupdict' This is really tough for someone like me to debug as I have no experience with Zope or Python. Any suggestions?

3 2

ZEO connections cache
by Pascal Peregrina 06 Jan '05

06 Jan '05

Hi, I am using Zope 2.7.3 with this configuration : + a ZEO instance with one ZODB + a Zope instance with Read/Write connections to the whole ZEO ZODB + several Zope instances with Read Only connections to one folder of the ZEO ZODB (+ a small local ZODB for the root folder, that never changes) It looks like some object changes (specially objects located in CMF portal_skins subfolders), are not always "seen" from one connection to another (either on the Zope instance where the changes were made or any other Zope instance). The problem is fixed when I minimize the connection caches. Anyone knows what could cause such an issue ? It appeared with Zope 2.7.3... (was ok on 2.7.2) But as we did other changes at the same time, I am 100% sure it's because of the Zope upgrade itself. Thanks a lot. Pascal ********************************************************************** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. This footnote also confirms that this email message has been swept by MIMEsweeper for the presence of computer viruses. www.mimesweeper.com **********************************************************************

3 2

RE: [Zope] Zope 2.7.3 Memory Leaks
by Andy Yates 06 Jan '05

06 Jan '05

> > You did this flushing and looking at the reference counts in > a process that already had run for several days (and therefore was quite > huge)? > It took about 24 hours. > > Do you use C extensions that create non-Python objects (and > therefore do not have reference counts and show up in the list)? > Maybe, such a C extension is leaking. No we do not use C extensions. In fact we can reproduce this behavior on a fresh install. On a fresh system create a python script that puts data in a session object. s = context.REQUEST.SESSION t = ' ' * 1024 s['data'] = t print "foo" return printed Then call this script with your favorite bench marking program. We used apache bench (ab). This will cause python2.3 to consume all available memory and crash or lockup. The speed at which this happens depends on the amount of data you assign to 't' and how fast you call the script. The session timeout does not seem to affect the memory use. We even tried setting the session timeout to 1 minute. In a very basic sense this is all our production server does. When a user first comes to our site we query a mysql database for several hundred values. These values are then stored in the session object as a map. All other pages are built dynamically based on the values stored in the session object. Is the session object system just not supposed to be used like this? > > Are your sessions huge? > Usually, they are stored as pickles in RAM. > If they were huge, some thousands of sessions might > consume a considerable amount of RAM. You would not see > them in the reference counts because Pickles are strings > and you see only instances. > > -- > Dieter I would say they are less than 15K each. Andy

3 2

Zope slow if left unused for hours
by Jeff Rodriguez 06 Jan '05

06 Jan '05

I'm running Zope with Plone, specifically the windows installer version distributed on the Plone website. The first time I hit the site (even the ZMI) the first page takes a long time to load; everything after that is speedy. I'm thinking it's some sort of caching issue but I'm not sure where to look to remedy the probelm. I am not running debug mode either. Info from control panel: Zope Version (unreleased version, python 2.3.3, win32) Python Version 2.3.3 (#51, Dec 18 2003, 20:22:39) [MSC v.1200 32 bit (Intel)] System Platform win32 SOFTWARE_HOME C:\Program Files\Plone 2\Zope\lib\python ZOPE_HOME C:\Program Files\Plone 2\Zope INSTANCE_HOME C:\Program Files\Plone 2\Data CLIENT_HOME C:\Program Files\Plone 2\Data\var Network Services ZServer.HTTPServer.zhttp_server (Port: 80) ZServer.HTTPServer.zhttp_server (Port: 8080) Process Id 1964 (3048) Running For 1 day 17 hours 6 min 34 sec -- Jeffrey Alan Rodriguez Jeffrey.Rodriguez(a)gmail.com

3 3