February 2003 - Zope-Dev

AIX
by wolfgangtex＠netscape.net 22 Feb '03

22 Feb '03

Hi, I run into the same problem that has been reported last year: Author:Jan Idzikowski Date: 04/24/2002 10:50 AM View: [Zope] Problems with AIX4 There never was an answer from anybody. I installed Python 2.1.3 and Zope-2.6.1 on AIX4.3.3 and I run into exactly the same scenario as Jan. ZServer starts up OK and I can login and bring up the control panel. I can also add folders. When I try to access /Examples or when I try to add the ZopeTutorial, Zope core dumps. When I run with the dbx debugger, I see that the runtime stack is busted. Usually with AIX there tend to be problem with shared libs. That doesn't seem to be the case here as I can successfully run all unit tests "testrunner.py". Is there anybody out there who was able to circumvent this problem? What would people suggest is a good way to debug this? Thanks! Wolfgang __________________________________________________________________ The NEW Netscape 7.0 browser is now available. Upgrade now! http://channels.netscape.com/ns/browsers/download.jsp Get your own FREE, personal Netscape Mail account today at http://webmail.netscape.com/

4 3

RDF Musings and TinyTables
by Shane Hathaway 21 Feb '03

21 Feb '03

I just read the RDF article published here: http://www.xml.com/pub/a/2003/02/12/rdflib.html I've understood the mechanics of RDF for a while, but never understood what makes it better than what we already have. Now I think I get it: RDF theory is a new kind of database abstraction. It's similar to a relational database in that you put pieces of data into the database and later search for data. But it's much more ad-hoc than a relational database. Serialization of RDF into XML and the relationship between RDF and the Semantic Web are distinct concepts from RDF theory. This ad-hoc data storage made me think of TinyTables. TinyTables is a good Zope product that fills the need for simple tables of data, but it needs attention. What if it got replaced by some Zope product called "RDFBucket"? An RDFBucket object would let you input data in a variety of ways, including object introspection, forms, and XML with embedded RDF. It would let you run queries similar to ZCatalog. Maybe it would also generate RDF for embedding metadata in web pages. I'm wondering if I'm thinking in line with RDF theory, or if I've veered off track. If you're familiar with RDF: What do you think? Shane

7 13

Re: [Zope-dev] RDF Musings and TinyTables - QL
by Lukasz Racon 21 Feb '03

21 Feb '03

[cut] > > Semantic Web are based on RDF: > > One path might be (not only one): > > RDF -> DAML+OIL -> OIL -> Description Logics further for example FaCT -> ALC > > and so on. > > Please don't use so many new acronyms. DAML and OIL are weird enough. > FaCT? ALC? I have no idea what you just suggested. :-) > My idea was that one can stay with RDF, RDFS, other will want OIL or DAML compatibile, and so on:) All depends on what one want RDF storage, ontologies or semantic web:) [Firstly OIL is based/uses description logic. FaCT (Fast Classification of Terminologies) is description logic system -classifier, reasoner. http://www.cs.man.ac.uk/~horrocks/FaCT/] [cut] > > You can implement RDF almost in any SQL language, and be able to Query > > rdfs. > > What does that mean? Do you mean that an RDF database could have a SQL > query interface? There is RDF Query Specification: http://www.w3.org/TandS/QL/QL98/pp/rdfquery.html Also there is DAML QL: http://www.daml.org/dql/ Check python's APIs:"RDFLib": http://rdflib.net/2002/11/05/rdflib-1.1.0/ (may use ZODB) There are also implemetation afaik in Java, php that store RDF in database, and alow you to query it. The best resourse list, I've seen, about RDF is "Dave Beckett's Resource Description Framework (RDF) Resource Guide": http://ilrt.org/discovery/rdf/resources/ search it for "query" or "python". [cut] > > I also consider this idea but I would do it more like RDFS - Folder like > > object with (rdf) properties containing other objects (subclasses). This is > > about "5" minutes of programing. > > I don't know what you're suggesting. > Shortly RDF can be thought as triples, in RDFSchema you have classes, subclasses:) If you think of folder as a class, you can inherite in sens of acquisition, but the main problem is multiple-inheritance, acquisition can work but makes it more complicated:). Lukasz

1 0

[BUG] Quadratic ZODB bloat caused by "PathIndex"
by Dieter Maurer 21 Feb '03

21 Feb '03

Zope 2.5.1 A "PathIndex" maps (pathsegment,level) onto the "IISet" of document ids with "pathsegment" at "level" in their path. An "IISet" is a single persistent object, written as a whole to the ZODB. Its size is proportional to the number of entries. Therefore a ZODB storage with undo support grows quadratically with respect to the number of entries (between packs). The standard "path" index indexes based on the physical path. Therefore, the size of the index entry of (at least) one of the top level pathsegments is in the order of all indexed objects. Once, you have lots of indexed objects you will observe significant ZODB growth between packs. The fix would be easy: "PathIndex" should use "IITreeSet" rather than "IISet" to store the document id lists (as do other indexes). (There are more bugs in "PathIndex": e.g. it does not remove old index information when a new "index_object" brings in new data. A code review would be appropriate.) A quick workaround: delete the "path" index unless you really need it. I will file a collector report. Dieter

3 2

Re: Bare "except" dangerous to ZODB?
by Jeremy Hylton 20 Feb '03

20 Feb '03

On Tue, 2003-02-11 at 04:13, zope-dev-request(a)zope.org wrote: > Chris McDonough wrote: > > Could this be done by initializing a dictionary at startup keyed on > > thread-id that a ConflictError exception's __init__ could stick a marker > > into, then checking that dictionary at commit time and disallowing the > > commit if the marker still existed? > > Yes, but Transaction objects are already keyed on the thread ID, so I > think you just have to set a "doomed" flag on the transaction. Attempts > to commit doomed transactions result in either ConflictError or > "DoomedTransactionError". ;-) Aborting the transaction (or beginning a > new transaction) resets the flag. > > Shane The doomed flag is the way zodb4 works. Each transaction has a status flag that can be one of: active, preparing, prepared, failed, committed, aborting, and aborted. Actions are only allowable in certain states. The only thing you can do to a failed transaction is abort it. And the only thing you can do to a prepared transaction is commit or abort it. I'd like to backport that to ZODB3, but I need to finish the transaction package for ZODB4 first. If the current problem is perceived to be a significant risk, we could increase the priority of the backport. One downside is that some people do strange things with transactions, like joining them during the commit; that doesn't work in ZODB4. Jeremy

4 9

Zope 2.5.1 with ZEO 2.0.2
by Brian R Brinegar 20 Feb '03

20 Feb '03

Hello, We are trying to upgrade the ZEO component of our Zope 2.5.1 system from ZEO 1.0 to ZEO 2.0.2. We are using Python 2.1.3, everything is compiled from source. Everything installs and starts fine, however when a request is made to the ZEO Client it hangs. The ZEO Server log shows no connection is made when the request is preformed. All of the ZEO unit tests are all successful. All of the files within the ZEO Client are owned by the httpd user. We run the start script as root. The problem is most definitly with the client, we can import zope on the client and connect to the ZEO Server from a python script. It seems like the main thread can access the ZEO Server, but ZServerPublisher threads cannot. Any ideas? Thanks, -Brian Brinegar ECN Web System Developer Purdue University Our start script looks like this: ---------------------------------------------------------- #! /bin/sh install_dir=/data/www/Zope.251.ZEO2 INST_HOME=${install_dir}/Zope export INST_HOME LD_LIBRARY_PATH=/data/www/Zope.251.ZEO2/lib export LD_LIBRARY_PATH PYTHONPATH=${install_dir}/lib/python2.1/site-packages/mx/DateTime/mxDateTime:${i nstall_dir}/lib/python2.1/site-packages/PIL:${install_dir}/Zope/lib/python/ZEO:$ {install_dir}/Zope/lib/python export PYTHONPATH exec ${install_dir}/bin/python $INST_HOME/z2.py -w 8080 -F 8081 -W 8082 -u httpd STUPID_LOG_FILE=/var/log/Zope.log STUPID_LOG_SEVERITY="-300" "$@"

2 1

zopezen site down
by Robert Anderson 20 Feb '03

20 Feb '03

Hi, Just went to visit zopezen.org and found the site was down because of a problem with an ISP or something. I have a dedicated P4 2.0Ghz server with 100-200 Gb of spare monthly traffic that I'd be willing to offer to the people or person running zopezen to help them get back online. There is no info on the site and a whois search doesn't provide any contact details. If the owners of ZopeZen are on this list please get in contact if you are would like a donation of some resources to help get and keep the site back online. If they are not on this list but someone on the list knows them, if you could pass this on to them, I'd be thankful. Now if being nice in real live could only improve my karma on /. I'd be happy ;-) Cheers -- Robert Anderson Managing Director Ecommerce Magic Ltd http://www.ecommerce-magic.com +64 21 808 525

2 1

RE: [Zope-dev] zope connector
by Tena Sakai 19 Feb '03

19 Feb '03

Many thanks, Sean. Your idea sounds interesting and require more investigation on my part. I need to write application on a remote zope server (via wan, not part of our domain, but an extranet site) to access database tables on my domain. I don't think the other server has ZEO running. (Neither do I, but I can do it since zope server is mine.) The other side may so "No," in which case would I still be able to do what you say with DBTab? Ie., without ZEO on the other side? Thank you. Tena Sakai sean.upton@uniont rib.com To: tena.sakai.b(a)bayer.com, zope-dev(a)zope.org Sent by: cc: zope-dev-admin@zo Subject: RE: [Zope-dev] zope connector pe.org 02/18/2003 02:14 PM Use ZEO and DBTab and a shared mounted object database that both Zope instances have access to. Put any objects that need to be accessed by both Zope servers in that common storage mounted at some folder-level in your zope setup. Sean -----Original Message----- From: Tena Sakai [mailto:tena.sakai.b@bayer.com] Sent: Tuesday, February 18, 2003 1:56 PM To: zope-dev(a)zope.org Subject: [Zope-dev] zope connector Folks, I am interested in accessing resorcces from two or more zope servers. For example, <br> hahaha! <br> <dtml-var name=funny> <br> hohoho! <br> The code snippet above will, when rendered, yield: hahaha! hehehe! hohoho! provided that the entity funny ultamately returns hehehe! and accessible within the name space. But how could I do this if the object funny is on a different zope server? Ie., how can I connect two name spaces on different zope servers in some not-so-caotic fasion? Thanks in advance. Regards, Tena Sakai _______________________________________________ Zope-Dev maillist - Zope-Dev(a)zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope ) _______________________________________________ Zope-Dev maillist - Zope-Dev(a)zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )

2 1

Re: [ZODB-Dev] Zope 2.5.1 with ZEO 2.0.2 (fwd)
by Brian R Brinegar 19 Feb '03

19 Feb '03

Thanks Tino, I did this: chown -R httpd * su httpd ./start and now I get this: Traceback (most recent call last): File "/data/www/Zope.251.ZEO2/Zope/z2.py", line 470, in ? import ZServer File "/data/www/Zope.251.ZEO2/src/Zope-2.5.1-src/ZServer/__init__.py", line 80, in ? from HTTPServer import zhttp_server, zhttp_handler File "/data/www/Zope.251.ZEO2/Zope/ZServer/HTTPServer.py", line 56, in ? from zLOG import LOG, register_subsystem, BLATHER, INFO, WARNING, ERROR ImportError: cannot import name LOG Don't get that when I start it as root. Any clues here? Thanks, -Brian On Wed, 19 Feb 2003, Tino Wildenhain wrote: > Hi, > > On Tue, 18 Feb 2003 21:36:22 -0500 (EST) > Brian R Brinegar <brinegar(a)ecn.purdue.edu> wrote: > > > Sent this to zope-dev and haven't gotten a response. > > > > Thanks, > > -Brian > > > > ---------- Forwarded message ---------- > > Date: Tue, 18 Feb 2003 13:57:02 -0500 (EST) > > From: Brian R Brinegar <brinegar(a)ecn.purdue.edu> > > To: zope-dev(a)zope.org > > Subject: Zope 2.5.1 with ZEO 2.0.2 > > > > Hello, > > > > We are trying to upgrade the ZEO component of our Zope 2.5.1 system from > > ZEO 1.0 to ZEO 2.0.2. We are using Python 2.1.3, everything is compiled > > from source. > > > > Everything installs and starts fine, however when a request is made to the > > ZEO Client it hangs. The ZEO Server log shows no connection is made when > > the request is preformed. > > This has happened to me too with 2.6 and ZEO2. One solution somebody came > up with was to start everything as the user who owns the files. > I was not able to veryfy this with systrace - however, it works for me. > > > Regards > Tino > > _______________________________________________ > For more information about ZODB, see the ZODB Wiki: > http://www.zope.org/Wikis/ZODB/ > > ZODB-Dev mailing list - ZODB-Dev(a)zope.org > http://mail.zope.org/mailman/listinfo/zodb-dev >

1 1

Security-Problem
by Andre Schubert 19 Feb '03

19 Feb '03

Hi all, i have a little Security-Problem which results in the following Error reported by Shane Hathaway's nice VerboseSecurity: Error Type: Unauthorized Error Value: The owner of the executing script does not have the required permission. Access to 'foobar' of (Folder instance at 932b600) denied. Access requires View_Permission, granted to the following roles: ['MSAdmin', 'Manager']. The executing script is (DTMLMethod instance at 8c8a508), owned by foo, who has the roles ['Authenticated', 'Owner']. I try to explain what happens. Lets say i have a user called foo who has Manager-Roles across a Zope-site. foo has added 2 DTMLMethods to a folder called bar and foobar. foobar is called from inside bar (<dtml-call foobar>). He also created a Role MSAdmin. bar is accessible and visible by Anonymous Users. foobar is accessible and visible by MSAdmin and Manager. If i view bar and login as a user with MSAdmin-Roles everything works fine. But if i remove the Manager-Role from foo who has created the two DTMLMethods i get the above error. I have the same problem with a really big Zope-Site where i have the remove Manager-Roles from a specific user. The only solution i have found is to recreate the DTMLMethods, but it is very hard to reacreate all DTMLMethods created by foo. I hope somebody has another hint for me. :) Regards, as

5 6