February 2005 - Zope

ZEO Strange Session KeyError When Load Balanced
by Jason J. W. Williams 12 Feb '05

12 Feb '05

Hello, I hope this is the correct place to post this question as I have not been able to resolve the problem via archives or Google. We have a setup with one ZEO server and two ZEO clients. The goal is to put a load balancer in front of the two clients and have them both operate off the same session data so that it appears as a single server to the end user. We setup the clients according to: http://longsleep.org/howto/sharesessionwithzeo However, when we run the setup whenever ZEO client 1 is hit for a page a KeyError is generated. I assume this is because ZEO client 2 set up the session and the data is not being shared. I upgraded us to Zope 2.7.4 last night in an attempt to fix the problem. Any help is greatly appreciated. Thank you in advance. Best Regards, Jason

4 8

Re: [Zope] ZEO Strange Session KeyError When Load Balanced
by Chris McDonough 12 Feb '05

12 Feb '05

Hi Jason, Please keep the discussion on the list, thanks... No, there are no other products that need to be updated. At this point, we'll need to see a full traceback (see the "error_log" object) to figure out what's happening. On Thu, 2005-02-10 at 13:44, Jason J. W. Williams wrote: > Yes I am. I was using 2.7.2 when the issue cropped up so I upgraded > both ZEO clients and the ZEO server to 2.7.4 last night. Same problem > occurs. Are there any products that need to be upgraded outside of > Zope? Thank you! > > -Jason > > > On Thu, 10 Feb 2005 13:27:31 -0500, Chris McDonough <chrism(a)plope.com> wrote: > > Hi Jason, > > > > Coding errors causing this symptom were present in Zopes before 2.7.3 > > but none have been reported to my knowledge thereafter. Are you still > > having this issue with 2.7.4? > > > > On Thu, 2005-02-10 at 11:44, Jason J. W. Williams wrote: > > > Hello, > > > > > > I hope this is the correct place to post this question as I have > > > not been able to resolve the problem via archives or Google. We have a > > > setup with one ZEO server and two ZEO clients. The goal is to put a > > > load balancer in front of the two clients and have them both operate > > > off the same session data so that it appears as a single server to the > > > end user. We setup the clients according to: > > > http://longsleep.org/howto/sharesessionwithzeo > > > > > > However, when we run the setup whenever ZEO client 1 is hit for a page > > > a KeyError is generated. I assume this is because ZEO client 2 set up > > > the session and the data is not being shared. I upgraded us to Zope > > > 2.7.4 last night in an attempt to fix the problem. Any help is greatly > > > appreciated. Thank you in advance. > > > > > > Best Regards, > > > Jason > > > _______________________________________________ > > > Zope maillist - Zope(a)zope.org > > > http://mail.zope.org/mailman/listinfo/zope > > > ** No cross posts or HTML encoding! ** > > > (Related lists - > > > http://mail.zope.org/mailman/listinfo/zope-announce > > > http://mail.zope.org/mailman/listinfo/zope-dev ) > > > > > > > >

3 3

Re: ChartDirector and Zope
by hpinson＠indepthl.com 11 Feb '05

11 Feb '05

I should add that the script works in a CGI environment, i.e Zope behind Apache, with the cgi-bin exposed. Could the problem be something to do with the external method attempting to write a png on the fly? Harlow Pinson Indepth Learning Email: hpinson(a)indepthl.com Web: http://www.indepthl.com Voice: 505-994-2135 FAX: 208-475-7678

1 0

dtml and 'none' behaviour
by garry saddington 11 Feb '05

11 Feb '05

I have a zsql method which returns some null values. These are then displayed in a table but the null values become 'None'. Is there any way to get round this behaviour and have empty cells in the displayed results? I can do it with several dtml-if and dtml-unless calls but wondered if there was a more subtle approach. regards garry

3 5

Zope and e-commerce
by George Tesseris 11 Feb '05

11 Feb '05

Is anyone actually having any luck with zope and e-commerce? http://www.zope.org/Products/commerce isn't really informing and ZCommerce list hasn't been active for a while... With wich existing framework I should start? Thanks, George

4 3

tutorial ZEO/Zope
by Rakotomandimby (R12y) Mihamina 11 Feb '05

11 Feb '05

Hello I'm lookong for a tutorial on having several Zope instances running behind a Zeo one. The several Zope instances would be Virtual Sites (listening on a non-80 Port), and the Zeo would listen on Port 80, and dispatches to the Zope instances. I heard it is possible... -- L'ASPO a pour but de démocratiser l'acces a l'informatique. Une de ses activité est l'infogerance (http://aspo.rktmb.org/activites/infogerance) Tél: + 33 2 38 04 26 04 ou + 33 6 33 26 13 14 (France)

3 2

Re: [Zope] Re: Ape backwards
by azazel 11 Feb '05

11 Feb '05

Il giorno ven, 11-02-2005 alle 14:31 +0100, martin f krafft ha scritto: > I want records created in the database outside of Zope to show up as objects in Zope automatically. The same applies to deletions. > > I want objects created through Zope to create appropriate records in the RDB. The same applies to deletions. > > I want to be able to edit objects and have the changes percolate to the database. I also want changes in the database to show up in the objects. > > Is this what Ape is all about? > Yes, even if the default SQL storage layout doesn't help you on this, it's schema is minimalistic and take cares of storing objects in a tree-oriented way. The main part of the sql schema are: - the "classification" table used by the Classification gateway to store classification data, wich maps objoid (the one you find on the attr _p_oid of every Persistent obj) to a class name and a mapper name which knows how to serialize and deserialize that class; - oid_seq is the generator of all the objoids; - the "folder_items" table contains parent/child tree relationship and child id which reflect the one you see via ZMI; - the "object_data" table contains the value ofd the "main data attribute" for each obj, like the text for pt and dtml, etc.; - the "properies" table contains main properties of a zope object common to all SimpleItem descendants, like id and title. Depending on the mapper used, a class dedicated table is created to store properties found on object of that class (if you create a folder, you will get a "folder_properties"). The mapping between class names and such tables is maintained in the table "property_tables". - Last but not least, the "remainder" table contains base64 encoded pickles of all the members of an object not serialized by "previous" serializers. Remainder serializer has the lowest priority, so it runs at the very end of the serialization /deserialization process; There are other tables used to store user and security stuff. That said , normal serialization involves some operations: 1) The oid-generator is queried, unfortunately without so much "context", so you can't generate table dedicated oids wich matches classic RDB surrogate keys; 2) The classifier classifies the obj and stores this information using the classification gateway; 3) The composite mapper takes care of serializing the obj, delegating the operation to serializers depending their priority; 4) finally a blind serialized is called to check if all has been serialized; Obviously, the deserialization process happens reversed. What is not so obvious (even if it should, really) is that the main parts of the deserialization process are at storage level: - the creation of a stub instance (empty) of the class the classification has found; - the merge operation of that stub instance with the deserialized members; This means that is really possible to control the process of instance creation, and that is possible to create an instance having starting only by classic RDB data and developing deserializers that take care of filling missing parts, remembering that deserialized members really overwrite preexisting (class) members at instance construction. > > I thought you were asking if you could make a relational table visible as Zope objects using APE, which it can theoretically do, and which I'm VERY interested in ;-) > > Yes, this is what I am asking, I think. Are there any examples of this? Ape looks complicated and before diving into the theory, I'd rather explore it in action first. > So I want a way to associate a folderish Archetype (essentially just a folderish CMF type) with a RDB table so that an instance thereof obtains and manages some of its associated data from/in the RDB. At the same time, the instance should also feel like a regular ZODB object, which I can copy/paste, and in which I can store objects for management by the ObjectManager. > > Will Ape help me here? Yes! I had your same idea so i setup a test sandbox with Archetypes 1.3 head Ape, PostgreSQL and ArchGenXML. I've setup an ape mount point under a plone site declaring (in zope.conf) that i wanted to use a Products.CMFPlone.PloneFolder.PloneFolder instance to be used for the mount point, so i can use it normally like a plone folder (unfortunately i wasn't able to instantiate correctly an Archetypes based folder). Then i built ArchGenXML's sample project outline_od.xmi running AGXML with "--ape" on command line to have default AT Ape mappers (wich then make use of stuff in Archetypes.Apexxx.py module) built automatically and i've installed the product in the portal. Default AT serializers use a dedicated table named like the class to store AT fields values. Despite of what the Archetypes.Apexxx module says on the top, i found that the references are working correctly. After that i wanted to seed if thougths on the deserialization process where correct, so instead of creating and Outline instance via zmi, i used normal "psql" command line tool (for postgres). I filled values for all the main tables: classification, folder_items, object_data, properties and outline (all using oids generated by the oid_seq). Leaving ther other untouched I then have flushed the storage cache to keep it in synk with the sql backend After that i browsed to the folder where i attached my sql built instances (in folder_items) and voilà, the instances are there! The first time i edited them, i got the remaining data (reminder, security, ecc) filled on the RDB. This is just a test done with the default sql storage configuration, but it proofs that with a custom developed ape storage one can reach a real tight integration between ZODB and relational databases. However i still need how to answer to some of the problems that arised: - The cataloging machinery nor the uid stuff are correctly initialized. They gets initialized the first time i edited the instances. I still have to find a good way to trigger such inits... - On my SQL data i use one id sequence per table where i use surrogate keys. I need to find a good schema layout to merge such a classic layout with a more zope storage oriented one using maybe oids like "<table_name>id". It would be useful also to better control AT UID creation and attribution so that they meaningful at SQL level. This will permit the automatic "rendering" of table relations using special AT reference fields; The use of unrestricted Python as procedure language on RDB can help on the first issue, triggering XML-RPC or simply http calls on object creation... I hope this helps, i'm sorry for my bad english. I would be useful share our thougths in an appropriate area of some site...:) bye, Alberto

1 0

POSKeyError
by Kevin Carlson 11 Feb '05

11 Feb '05

Hi all, Whenever I try to reindex an index in the portal_catalog or delete the index, add it back and then reindex, I get the first error below. I ran fstest.py and there were no errors in the Data.fs file yet. I also ran fsrecover.py and there were zero bytes removed from the Data.fs file. Also, When I run fsrefs.py, I get the second bit of output below. You may have seen my recent posts about the BTreeFolder2 instance that stores the vast majority of the content for this application. It has been suggested that the BTreeFolder2 instance may have corrupt BTrees so I rebuilt those using Tres Seaver's method but the behavior stays the same. Any ideas on this? Exception Type POSKeyError Exception Value 00000000000cc49a Traceback (innermost last): * Module ZPublisher.Publish, line 101, in publish * Module ZPublisher.mapply, line 88, in mapply * Module ZPublisher.Publish, line 39, in call_object * Module Products.ZCatalog.ZCatalog, line 499, in manage_reindexIndex * Module Products.ZCatalog.ZCatalog, line 485, in reindexIndex * Module Products.CMFCore.CatalogTool, line 207, in catalog_object * Module Products.CMFCore.WorkflowTool, line 353, in getCatalogVariablesFor * Module Products.CMFCore.WorkflowTool, line 338, in getWorkflowsFor * Module Products.CMFCore.WorkflowTool, line 307, in getChainFor * Module ZODB.Connection, line 559, in setstate * Module ZODB.FileStorage, line 689, in load * Module ZODB.FileStorage, line 657, in _load POSKeyError: 00000000000cc49a -------------------------------- fsrefs.py output oid 0xC8DF8L BTrees.OOBTree.OOBucket last updated: 2005-01-25 09:42:25.200913, tid=0x35AC9C66B861E00L refers to invalid object: oid 0xCC49AL missing: 'Products.CMFDefault.File.File' oid 0xC8E1FL BTrees.OOBTree.OOBucket last updated: 2005-01-25 09:42:25.200913, tid=0x35AC9C66B861E00L refers to invalid object: oid 0xCC49CL missing: 'BTrees.IOBTree.IOBTree' oid 0xD297EL BTrees.OOBTree.OOBucket last updated: 2005-02-10 04:08:47.313263, tid=0x35B2278C9DEB333L refers to invalid object: oid 0xCC49AL missing: 'Products.CMFDefault.File.File'

2 1

dictionary entries keyed by date - get()
by David Siedband 11 Feb '05

11 Feb '05

I've got a python script that maps a bunch of event records (results of a zSQL query) to a python dictionary, keyed by date. Inside the dtml-calendar tag, I'm trying to use the get() method to return the events for the day that the calendar iterator is on. I've tried a bunch of variations on this, but none of them return any results from the dictionary on days when there are definitely corresponding events. <dtml-in "myEvents.get(date.Date(), None)" mapping> <dtml-in "myEvents.get(date, None)" mapping> <dtml-in "myEvents.get(date)" mapping> how do I make this work? thanks -- David Siedband generation-xml.com

2 1

Using AWSTATS with Zope
by Martin Koekenberg 11 Feb '05

11 Feb '05

Hello, I'm using awstats for mij zope websites. In front op zope I use Apache. On this moment the awstats pages are not secure. How can I make these secure with my zope login. I use the extensible user folder. awstats is a perlscript with arguments... awstats.pl?config=............. Who can help me ? Thanks, Martin Koekenberg * <http://zope.org/Members/TheJester/exUserFolder> *

3 2