- Zope - Zope lists

Zope will not start after failed 2.8.1 upgrade
by hpinson＠indepthl.com 02 Sep '05

02 Sep '05

Upgraded to Zope 2.8.1 on Fedora Core 2, compiled with Python 2.3.5 (sitting alongside in the paralell to the system python). Zope started, but with errors. Reverted back to my former stable Zope 2.7.7 and Python 2.3.3, but Zope will not start at all now. Running the debugger reveals this. Any suggestions as to how to recover. I am at a total loss. export EVENT_LOG_FILE EVENT_LOG_FILE= /var/zope-instance/bin/runzope Traceback (most recent call last): File "/var/zope277/lib/python/Zope/Startup/run.py", line 50, in ? run() File "/var/zope277/lib/python/Zope/Startup/run.py", line 19, in run start_zope(opts.configroot) File "/var/zope277/lib/python/Zope/Startup/__init__.py", line 52, in start_zope starter.startZope() File "/var/zope277/lib/python/Zope/Startup/__init__.py", line 231, in startZope Zope.startup() File "/var/zope277/lib/python/Zope/__init__.py", line 47, in startup _startup() File "/var/zope277/lib/python/Zope/App/startup.py", line 96, in startup OFS.Application.initialize(application) File "/var/zope277/lib/python/OFS/Application.py", line 278, in initialize initializer.initialize() File "/var/zope277/lib/python/OFS/Application.py", line 303, in initialize self.install_inituser() File "/var/zope277/lib/python/OFS/Application.py", line 484, in install_inituser app.acl_users._createInitialUser() File "/var/zope277/lib/python/AccessControl/User.py", line 1075, in _createInitialUser if len(self.data) <= 1: File "/usr/lib/python2.3/UserDict.py", line 18, in __len__ def __len__(self): return len(self.data) File "/var/zope277/lib/python/ZODB/Connection.py", line 600, in setstate self._set_ghost_state(obj, p) File "/var/zope277/lib/python/ZODB/Connection.py", line 638, in _set_ghost_state unpickler.load() ImportError: No module named mapping -- Harlow Pinson Indepth Learning Email: hpinson(a)indepthl.com Phone: 505 994-2135 Fax: 505 994-3603

1 0

RE: [Zope] Zope scalabilty and problems
by Kennamore, Matthew G [NTK] 02 Sep '05

02 Sep '05

Zope version 2.7.3 (planning to goto 2.7.7 soon with ZODB 3.2.9) Pyhton is 2.3.4 Apache 1.3 We have 943 users as of this minute with a bout 1000 objects being created a day (Lots of creates) -----Original Message----- From: Chris McDonough [mailto:chrism@plope.com] Sent: Thursday, September 01, 2005 12:51 PM To: Kennamore, Matthew G [NTK] Cc: zope(a)zope.org Subject: Re: [Zope] Zope scalabilty and problems Your "tranaaction blocked" error messages seem to imply that either or both of the following is true: - some transactions are taking a "long time" (any more than, say, 200 milliseconds is a long time) - you have a very high transaction volume. That said, these messages are informational rather than signifying an error condition. Some transaction blockage is expected since the ZEO server can only deal with one transaction at a time. What version of Zope are you using? Is this an "intranet" application? Are there lots of users creating content? Can you venture a guess as to how many users are "creating" content vs. "viewing" content at any given time? Are the users that are creating content logged in? The users that are viewing content? On Wed, 2005-08-31 at 11:03 -0500, Kennamore, Matthew G [NTK] wrote: > Here is our situation, we originally launched zope with a small user > base in mind and like most IT implementations it got away from us > quickly and we have over 1000 users now. We are experiencing huge > slowdowns and lots of complaints of performance. > > Let me outline our system: > > I have a load balancer that round robins incoming request to 3 zeo > servers > > I have 1 zope server on the back en that severs the data, this is a > large single processor machine with 4 gigs of ram > > Each zeo server is 2 gigs of ram, single processor 3.2 gighz > > The throughput doesn't appear to be the problem as ram/processors are. > > Short term I plan to change all zeo's to 4 gigs ram and add 3 > additional servers. > > > The Technologies we are using are Zope, Zeo, plone and so forth. Why > are we having these large issues? I see sites with hundreds of > thousands of users and they don't seem to have these issues? We plan > to recode our site to get away from the Data.fs as soon as we can but > that is a ways off yet. What am I doing wrong can anyone help? > > _______________________________________________ > Zope maillist - Zope(a)zope.org > http://mail.zope.org/mailman/listinfo/zope > ** No cross posts or HTML encoding! ** > (Related lists - > http://mail.zope.org/mailman/listinfo/zope-announce > http://mail.zope.org/mailman/listinfo/zope-dev )

3 2

Adding a zope product
by Paul Hendrick 02 Sep '05

02 Sep '05

Hi all, i've just started with zope, and i'm trying to write a filesystem product, so i can have a project in svn and work on it in the filesystem. I've followed the guide at zope.org for creating a minimal product, but can't get this to show up in the list of products. Can anyone see whats wrong? Thanks for reading, Paul __init.py__ ----------- import minimal def initialize(context): """init the product""" contect.registerClass(minimal.minimal,constructor=(minimal.manage_addMinimal,)) minimal.py ---------- from OFS import SimpleItem class minimal(SimpleItem.SimpleItem): """minimal object""" meta_type = 'minimal' def __init__(self,id): """initialise new instance""" self.id = id def index_html(self): """used to view content of the object""" return '<html><body> Hello </body></html>' def manage_addMinimal(self, RESPONSE): """add minimal obj to folder""" self._setObject('minimal_id', minimal('minimal_id')) RESPONSE.redirect('index_html')

4 4

Zope startup problem: AttributeError: 'module' object has no attribute 'loadSchema'
by Paul Sue 02 Sep '05

02 Sep '05

Hi, Found a spare Solaris 8 server, so I thought I'd tried building Zope/Plone on it. Built python 2.3.4, Zope 2.7.4 OK. When I start up zope, I get: Traceback (most recent call last): File "/space/users/zope/Zope274/lib/python/Zope/Startup/run.py", line 50, in ? run() File "/space/users/zope/Zope274/lib/python/Zope/Startup/run.py", line 18, in run opts = _setconfig() File "/space/users/zope/Zope274/lib/python/Zope/Startup/run.py", line 42, in _setconfig opts.realize(doc="Sorry, no option docs yet.") File "/space/users/zope/Zope274/lib/python/zdaemon/zdoptions.py", line 271, in realize self.load_schema() File "/space/users/zope/Zope274/lib/python/zdaemon/zdoptions.py", line 312, in load_schema self.schema = ZConfig.loadSchema(self.schemafile) AttributeError: 'module' object has no attribute 'loadSchema' Any pointers would be greatly appreciated. Thanks, Paul

2 1

(1 conflicts since startup at 2005-08-04T14:45:39)
by Garito 02 Sep '05

02 Sep '05

Hi all! We have: Zope Version (Zope 2.7.4-0, python 2.3.4, linux2) Python Version 2.3.4 (#1, May 19 2005, 17:40:30) [GCC 3.3.5-20050130 (Gentoo 3.3.5.20050130-r1, ssp-3.3.5.20050130-1, pie-8.7.7. System Platform linux2 and Archetypes 1.3.2-final CMF 1.4.7 Epoz 0.9.0 Our problem is we create some archetypes and in some parts of our structure if we try to create some object the computer cpu grows to 100% and raises 2005-08-04T15:01:02 INFO(0) ZODB conflict error at /VirtualHostBase/<<the url to the object>>/createObject (1 conflicts since startup at 2005-08-04T14:45:39) Has someone any idea to solve these issue? On development time nothing of these occurs and when we go to production time these problem begins (for that these question is, for us, urgent) Thank you very much -- Mis Cosas http://blogs.sistes.net/Garito/

4 4

RE: [Zope] Sending Fax through MailHost
by Chris Larsen 02 Sep '05

02 Sep '05

Thanks guys, Chris, I saw that existed.. and I do see that it's a lot more straightforward. Lennart- the fax piece is something on my exchange server so as long as the headers are correct it will interpret and route to the physical fax server accordingly. The problem is that I can't seem to discover through googling what these headers look like. Oh well, something for the castelle faxpress people (after $250/hr for support ugg). The smtp sendable gateway is probably some plugin they have available and I'll check it out. Just figured someone may have run into this and found a workaround. Thanks chieftains, Chrisbob -----Original Message----- From: Lennart Regebro [mailto:regebro@gmail.com] Sent: Thursday, September 01, 2005 4:27 AM To: Chris Larsen Cc: zope(a)zope.org Subject: Re: [Zope] Sending Fax through MailHost What you are trying to do has nothing with SMTP to do. It's fully MS Outlook specific. You would have to write a mailhost that does not use SMTP, but integrated directly to an outlook server. I have no idea of how to do that, or even if it's possible. What you might want to do instead, is too see if you can make the fax software you are using be a SMTP-mail to fax gateway. I.e., if you somehow can send SMTP mails to it. In that case, the mail adress would be something like "555-28376(a)fax.your.server", which would be a valid SMTP address.

3 2

RE: [Zope] HELP!! Data.fs corrupted
by Paul Sue 01 Sep '05

01 Sep '05

Sorry, I should have posted an update to the list .. I figured out the problem .. Had to install LDAPUserFolder and CMFLDAP. All is working now! Thx, Paul -----Original Message----- From: Dieter Maurer [mailto:dieter@handshake.de] Sent: Thursday, September 01, 2005 12:51 PM To: Paul Sue Cc: zope(a)zope.org Subject: RE: [Zope] HELP!! Data.fs corrupted Paul Sue wrote at 2005-8-31 14:36 -0700: > ... > * Module AccessControl.User, line 641, in validate > * Module Products.GroupUserFolder.GroupUserFolder, line 980, in > authenticate There were a few more lines after this traceback -- essential ones. Look at them and then look at line 980 in the module identified above. -- Dieter

1 0

RE: [Zope] HELP!! Data.fs corrupted
by Paul Sue 01 Sep '05

01 Sep '05

Actually, I was able to find a good copy of Data.fs. OK, so I copied over to the new server; Zope started OK. I can get to the ZMI but when I try to view my site, I get: Site Error An error was encountered while publishing this resource. AttributeError Sorry, a site error occurred. Traceback (innermost last): * Module ZPublisher.Publish, line 175, in publish_module_standard * Module Products.PlacelessTranslationService.PatchStringIO, line 51, in new_publish * Module ZPublisher.Publish, line 132, in publish * Module Zope.App.startup, line 204, in zpublisher_exception_hook * Module ZPublisher.Publish, line 92, in publish * Module Products.UserTrack.UserTrack, line 75, in wrappedTraverse * Module ZPublisher.BaseRequest, line 433, in traverse * Module AccessControl.User, line 641, in validate * Module Products.GroupUserFolder.GroupUserFolder, line 980, in authenticate Any ideas?? -----Original Message----- From: Dieter Maurer [mailto:dieter@handshake.de] Sent: Wednesday, August 31, 2005 12:28 PM To: Paul Sue Cc: zope(a)zope.org Subject: Re: [Zope] HELP!! Data.fs corrupted Paul Sue wrote at 2005-8-31 01:31 -0700: > ... >./repozo.py -Rv -r /temp/recover -o Data.fs > >However, when I start up Zope, I get: > >2005-08-31T01:20:21 PANIC(300) ZODB FS FS21 ERROR: >/home/zope/ssoi/var/Data.fs data record exceeds transaction record at 54956706 .... >.... >ZODB.FileStorage.CorruptedTransactionError: /home/zope/ssoi/var/Data.fs >data record exceeds transaction record at 54956706 You may try "fsrecover". Be warned however, that it will loose information (at least the broken transaction will be lost). -- Dieter

3 2

Help STX in UTF-8
by Vlada Macek 01 Sep '05

01 Sep '05

I registered the help directory using context.registerHelp(directory='help') in my product's __init__.py. Then I placed UTF-8 encoded STX file in my language there, but the help via ZMI is displayed with garbled UTF-8 chars. It's unreadable, but it is not the matter of browser's Display encoding switch. It's Zope 2.7.5. What can I do to display the file correctly? -- \//\/\ (Sometimes credited as 1494 F8DD 6379 4CD7 E7E3 1FC9 D750 4243 1F05 9424.)

3 2

RE: [Zope] Zope scalabilty and problems
by Kennamore, Matthew G [NTK] 01 Sep '05

01 Sep '05

Here is some of the information I can provide, some I'll have to go check. Database: In the past hour we had 1204 Object Stores and 159433 Loads and 465 connections. -----Original Message----- From: Andrew Sawyers [mailto:andrew@zope.com] Sent: Thursday, September 01, 2005 1:30 PM To: Kennamore, Matthew G [NTK]; 'Chris McDonough' Cc: zope(a)zope.org Subject: RE: [Zope] Zope scalabilty and problems Sorry, I missed the beginning of this thread, I've got some questions that I didn't see answered or asked: Did Matt indicate if he was running multiple zeo app servers? It might help to be spreading the load. 1,0000 writes a day is not outrageous....so it's possible that really what you need to spread the load across a load balanced pool of zeo app servers. How many users are authenticated at any given time actually using the system for writing? Are you running a persistent or non-persistent cache? If so, what size it is? Check the control panel, under database management and choose your database, then look at the activity tab. Do you have a high volume of object loads? What is the volume of object stores? There is also an in-memory zeo object cache - click the cache parameters tab and see the number of objects in your in-memory cache. If your zeo client(s) have lots of ram (they definitely should), you can crank this up as well. What is the 'horespower' of your app server(s)? Andrew -- Zope Managed Hosting Software Engineer Zope Corporation (540) 361-1700 > -----Original Message----- > From: zope-bounces(a)zope.org [mailto:zope-bounces@zope.org] On Behalf Of > Kennamore, Matthew G [NTK] > Sent: Thursday, September 01, 2005 1:19 PM > To: Chris McDonough > Cc: zope(a)zope.org > Subject: RE: [Zope] Zope scalabilty and problems > > Thanks everyone for their suggestions, bought a squid book today and I > know what I'll be doing all weekend <grin> > > -----Original Message----- > From: Chris McDonough [mailto:chrism@plope.com] > Sent: Thursday, September 01, 2005 1:13 PM > To: Kennamore, Matthew G [NTK] > Cc: zope(a)zope.org > Subject: RE: [Zope] Zope scalabilty and problems > > What you've got now is a pretty reasonable setup. Moving to 2.7.7 will > likely not get you any "free" performance increases and it doesn't > appear that there are any "critical" ZODB bugfixes relating to your > problems since 2.7.3. FWIW, also, I'd venture a guess that moving "off > Data.fs" (as you mentioned in your original email) may be quite costly, > requiring a lot of application recoding. It also might not help solve > the scaling problem you're having. It's a "high risk, potentially low > reward" solution. You need something that is low-risk and potentially > high reward, I'd suspect. > > Others have said this, but it bears repeating. The biggest > "administrative" win you can get for the cheapest cost is to add an HTTP > cache (like Squid or even Apache's mod_proxy) in front of your ZEO > clients and to cause your Zope application to set the proper response > headers which allow the cache server to cache (and thus serve) those > pages on subsequent requests. > > This can be tricky when most of your traffic is authenticated because > there is usually very little win and a lot of danger to serving up > cached pages when a page in the cache represents a view that a > privileged user sees when visiting the site. You typically don't want > other people to see the same thing he does. As a result, typically > people will say "pages that require authentication can't be cached" > which isn't entirely true (you can cache them but it's often useless). > > However, even serving up fully static content that doesn't require any > authentication like CSS, images, and so on can be a win. You might > start there. > > HTH, > > - C > > > On Thu, 2005-09-01 at 11:54 -0500, Kennamore, Matthew G [NTK] wrote: > > Zope version 2.7.3 (planning to goto 2.7.7 soon with ZODB 3.2.9) > > Pyhton is 2.3.4 > > Apache 1.3 > > > > We have 943 users as of this minute with a bout 1000 objects being > created a day (Lots of creates) > > > > -----Original Message----- > > From: Chris McDonough [mailto:chrism@plope.com] > > Sent: Thursday, September 01, 2005 12:51 PM > > To: Kennamore, Matthew G [NTK] > > Cc: zope(a)zope.org > > Subject: Re: [Zope] Zope scalabilty and problems > > > > Your "tranaaction blocked" error messages seem to imply that either or > > both of the following is true: > > > > - some transactions are taking a "long time" > > (any more than, say, 200 milliseconds is a long time) > > > > - you have a very high transaction volume. > > > > That said, these messages are informational rather than signifying an > > error condition. Some transaction blockage is expected since the ZEO > > server can only deal with one transaction at a time. > > > > What version of Zope are you using? > > > > Is this an "intranet" application? Are there lots of users creating > > content? Can you venture a guess as to how many users are "creating" > > content vs. "viewing" content at any given time? Are the users that are > > creating content logged in? The users that are viewing content? > > > > On Wed, 2005-08-31 at 11:03 -0500, Kennamore, Matthew G [NTK] wrote: > > > Here is our situation, we originally launched zope with a small user > > > base in mind and like most IT implementations it got away from us > > > quickly and we have over 1000 users now. We are experiencing huge > > > slowdowns and lots of complaints of performance. > > > > > > Let me outline our system: > > > > > > I have a load balancer that round robins incoming request to 3 zeo > > > servers > > > > > > I have 1 zope server on the back en that severs the data, this is a > > > large single processor machine with 4 gigs of ram > > > > > > Each zeo server is 2 gigs of ram, single processor 3.2 gighz > > > > > > The throughput doesn't appear to be the problem as ram/processors are. > > > > > > Short term I plan to change all zeo's to 4 gigs ram and add 3 > > > additional servers. > > > > > > > > > The Technologies we are using are Zope, Zeo, plone and so forth. Why > > > are we having these large issues? I see sites with hundreds of > > > thousands of users and they don't seem to have these issues? We plan > > > to recode our site to get away from the Data.fs as soon as we can but > > > that is a ways off yet. What am I doing wrong can anyone help? > > > > > > _______________________________________________ > > > Zope maillist - Zope(a)zope.org > > > http://mail.zope.org/mailman/listinfo/zope > > > ** No cross posts or HTML encoding! ** > > > (Related lists - > > > http://mail.zope.org/mailman/listinfo/zope-announce > > > http://mail.zope.org/mailman/listinfo/zope-dev ) > > > > > > > > _______________________________________________ > Zope maillist - Zope(a)zope.org > http://mail.zope.org/mailman/listinfo/zope > ** No cross posts or HTML encoding! ** > (Related lists - > http://mail.zope.org/mailman/listinfo/zope-announce > http://mail.zope.org/mailman/listinfo/zope-dev )

1 0