- Zope - Zope lists

zope tutorial blues
by aamehl 07 Jun '04

07 Jun '04

Hi all, I am trying to the zope tutorial and I find that It is missing images and subdirectories. Maybe I installed it wrong, or i am indeed missing pieces. I remember starting the tutorial previously and not getting an error that I am missing images etc. Anyone have an idea how to get it up and running? Thanks Aaron

1 1

Touchy APE?
by Anton Stonor 07 Jun '04

07 Jun '04

I've been playing around with Shane's excellent APE (http://hathaway.freezope.org/Software/Ape) Cool concept. However it seems to be a bit more touchy to certain objects than the default ZODB filestorage. In other words: Objects such as Btreefolder2 and Group User Folders work using default ZODB filestorage, but break with APE. Maybe it's just my environment, but on the other hand APE might (on purpose?) be more touchy. So I don't know whether to file this as a bug or not -- or if it's APE's or the other projects fault. Any thoughts? My environment: Windows 2000 Zope 2.7.0 Ape 0.8 (also tried the CVS-version) Ape file storage (also tried Mysql storage) GRUF 2.0.1 BTreeFolder2 1.0 Btreefolder2 traceback: 2004-06-07T20:47:51 ERROR(200) ZODB Couldn't load state for '17' Traceback (most recent call last): File "c:\zopesand\Products\Ape\lib\apelib\zodb3\connection.py", line 359, in setstate event = osio.deserialize(oid, obj, classification, state) File "c:\zopesand\Products\Ape\lib\apelib\core\io.py", line 160, in deserialize mapper.serializer.deserialize(event, state) File "c:\zopesand\Products\Ape\lib\apelib\core\serializers.py", line 102, in deserialize s.deserialize(event, state) File "c:\zopesand\Products\Ape\lib\apelib\zope2\ofsserial.py", line 129, in deserialize obj._initBTrees() File "C:\zopedev\Products\BTreeFolder2\BTreeFolder2.py", line 477, in __getattr__ res = self._tree.get(name) AttributeError: 'NoneType' object has no attribute 'get' ---- GRUF traceback: Traceback (innermost last): * Module ZPublisher.Publish, line 104, in publish * Module Zope.App.startup, line 221, in commit * Module ZODB.Transaction, line 233, in commit * Module ZODB.Transaction, line 348, in _commit_objects * Module apelib.zodb3.connection, line 263, in commit * Module apelib.core.io, line 152, in serialize * Module apelib.core.serializers, line 93, in serialize * Module apelib.zope2.security, line 103, in serialize * Module Products.GroupUserFolder.DynaList, line 24, in __getitem__ * Module Products.GroupUserFolder.GRUFFolder, line 153, in data * Module Products.GroupUserFolder.GRUFFolder, line 186, in userdefined_roles * Module Products.GroupUserFolder.GRUFFolder, line 180, in listGroups AttributeError: Groups /Anton

1 0

Invoking an executable from zope
by Kailashnath_Ganesan 07 Jun '04

07 Jun '04

Hi, I need to invoke an executable file from zope. I am not able to import modules like os or nt in python script. I also tried to use an external method, but am not able to do so. Zope hangs and I am not able to restart it without restarting the machine. Is there any built-in functions in python to accomplish this? Can we do this from zope itself?? Plz explain. Thanks and regards,

3 3

Re: Group mapping not working on LDAPUserFolder
by Josef Albert Meile 07 Jun '04

07 Jun '04

> > 1) We have an extra attribute for the LDAP Schema: > > LDAP Attribute Name: ou > > Friendly Name: group > > Multi-valued: Yes > >This is an unsupported way of storing group membership. > >jens Yes, I know. Actually I didn't set up the LDAP, I'm just using it. Anyway, group mapping should work without that attribute, shouldn't it? Does the page template work for you? Thanks, Josef _________________________________________________________________ The new MSN 8: smart spam protection and 2 months FREE* http://join.msn.com/?page=features/junkmail

2 1

Link of the Day
by Bert Vanderbauwhede 07 Jun '04

07 Jun '04

Last friday, my Zope-site locked up again. The same thing happened to me 9 days before ("Zope locks up", 05/27/2004). I'll try to give more details on what happened. SETUP ===== * RedHat 8 * Apache 2.0.40 * Zope 2.6.4 * Python 2.1.3 * CMF 1.2 Apache and Zope run on separate servers, both Dell PowerEdges. The connection between Apache and Zope is established through RewriteRules and SiteRoots (I'm planning to switch to VirtualHostMonster). I also use Apache for SSL. PERFORMANCE MONITORING ====================== I monitor the performance of the site by checking the number of httpd-threads. When everything is fine, there are about 20 to 23 threads. When this number goes up, the site is slowing down. When the number of threads reaches 150 (the maximum number of threads configured in httpd.conf), the site has locked up. Nothing happens anymore. I run Zope with 4 threads to resolve requests. This should be enough, everybody tells me. But what if some of these threads are waiting for data from external databases. In my case, LDAP was a problem. We used an old version of OpenLDAP (1.2) which had some serious memory leaks. When the load of the LDAP-server started peaking, the number of httpd-threads peaked also. When the load of the LDAP-server went down, the number of httpd-processes went also down. I don't have to do anything, the problem disappears all by itself. THE PROBLEM =========== Friday, suddenly the number of httpd-threads started rising, and soon reached the maximum of 150. The site had locked up. I checked, but the problem was not related to LDAP (as far as I could see). First, there were no load-problems with LDAP. Second, I switched to another LDAP-server, which uses a recent version of OpenLDAP. This version doesn't have those memory leak problems. And the worst part: the problem didn't go away. The performance problems with LDAP usually don't last very long. But this time (and the time before), the problem lasted for hours. INTERLUDE: WEBDAV/MICROSOFT PROBLEMS ==================================== I've had a similar problem about a year ago. My website contains some MS Word-documents. A couple of times, the site locked up when someone tried to download one of those documents. What happened was this: they clicked a link to a Word-document, so it would open immediately in their browser. When this happens, some versions of Microsoft Word keep on sending PROPFIND-requests (PROPFIND is a WebDAV method) to the server (to the http-port, not the WebDAV-port). This caused Zope to slow down, and eventually lock up. I solved this problem by adding a RewriteRule that returned an "403 - Forbidden" when someone sent a WebDAV-request to ports 80 or 443. This solved the problem. THINGS I'VE TRIED ================= * Restarting Zope: This didn't work. Immediately after I've restarted Zope, the number of httpd-threads started rising again. * Switching back to an older Data.fs: I had made some major changes friday, so maybe they were the cause of the problems. I replaced Data.fs by Data.fs from the day before, but it didn't work. The number of httpd-threads rose again. * Using another Zope server: Maybe it's a problem with my Zope server. Luckily, I have another Zope server running, with the same site. I changed httpd.conf, so that requests were forwarded to this other server. The problem didn't go away. * Raising the maximum number of httpd-threads: This was a suggestion of a colleague. I raised the maximum number of threads to 300. This time, the maximum number of threads rose to 300. So the problem didn't go away. * Excluding internal users with iptables: I configured iptables, so that any internal requests (requests from users at the university) were rejected. Immediately, the number of httpd-threads went down to a comfortable 21 (I did not restart Zope or Apache). When I restored iptables, so that internal requests were accepted again, the number of httpd-threads remained at 21. Temporarily excluding local users seemed to have solved the problem. CONCLUSIONS =========== The only thing I can conclude, is that the problem is caused by requests that somehow lock up Zope. These requests come from one or more users at the university. Unfortunately, I can only be sure if the problem happens again. I'm not sure if I want this to happen. I am thinking of using som kind of log replayer, so I can simulate what happened friday with another server. Maybe that way I can see if the requests are indeed the problem. QUESTIONS ========= 1. Is my conclusion correct? 2. What would you do in this situation? Bert Vanderbauwhede... -- "I laugh in the face of danger. Then I hide until it goes away." -- Alexander LaVelle Harris

3 3

Z PDF Document
by Asad Habib 07 Jun '04

07 Jun '04

Hello. Does anyone know how to remove the header and footer lines from a Z PDF document? I set the Header_line_thickness property to 0 as the documentation stated, but this did not get rid of the line altogether but simply gave me a thinner line. Any help would be greatly appreciated. Thanks. - Asad

1 0

ZFloatMenu problem
by Jeevan 07 Jun '04

07 Jun '04

I have a suggestion for Zope, mainly for the ZFloatMenu product but.. I just can't find the most appropriate email address for this in your site, I'd thought I write it here and maybe it will reach the right person, eventualy. I want to build an application that will use the ZFloatMenu product to create dynamic menu, but I face a major problem. The 'title' field, of which the final rendered text of the menu bar is based on, cannot accept hebrew characters. What I want to suggest is to simply add an additional 'content' attribute for the menus that will 'take-over' and replace the title text in the menu rendered. Of course it should be of a ustring (not that I understand too much about it) type to enable input of characters in a different language. That in fact will make the product available for non-english content creation. Thank you very much jeevan

1 0

Re: Group mapping not working on LDAPUserFolder
by Josef Albert Meile 07 Jun '04

07 Jun '04

>I'm not able to tell entirely from your verbal description, but are >you saying that you've added an attribute to your users so that each >user record contains the list of groups to which it belongs, and >that attribute is 'ou'? This seems odd, not to mention confusing >in that 'ou', an organizational unit, is typically structural and >holds other entries, you certainly could have picked a better name >for this. I don't do that, the people who set-up the ldap did it. I don't know either why. >This alone isn't enough for LDAPUserFolder to map groups to (assuming >that I understand LDAPUserFolder and your description properly). In >fact, it will merely see this as an additional attribute for your >user records Actually with the patch I did it maps the groups correctly, but it's not an standard way. > > Login Name Attribute: uid > > RDN Attribute: uid > > Users Base DN: ou=grp1,ou=grp2,ou=grp3,ou=grp4,o=org,c=country > > Scope: SUBTREE > > Group storage: Groups stored on LDAP server > > Groups Base DN: cn=foo_account,ou=admins,ou=grp3,ou=grp4,o=org,c=country > > Password: xxxxxx > > Manager DN Usage: Always > > Read-only checked > > User password encryption: SSHA > > Default User Roles: LDAP=Anonymous > > > > >Your "Groups Base DN" goes one level too low. You need to point to >a structural entry which contains your group entries. The groups >themselves must be something like groupOfUniqueNames, and must have >individual attribute values for uniqueMember for every member of >that group. > >LDAPUserFolder covers this in the README and comes with some simple >LDIF examples that illustrate this. > > > > > 2) Group mapping on the LDAPUserFolder's "groups" Tab: > > "foo_group" maps to zope role "Manager" > > >Once you point the "Groups Base DN" to the (or a) parent element >of cn=foo_group, and cn=foo_group is of objectClass >'groupOfUniqueNames', and your user is listed as a 'uniqueMember', >*then* this will work properly and user 'my_login_name' will have >the 'Manager' role. Actually with that "Groups base DN" and deleting the "ou" attribute, I can see every group when doing a search from the manage interface, but when a user authentificates itself, it can get the groups to which he belongs to. Anyway, I will check what you said. > >Hope I've followed your description correctly, and I hope this >helps...LDAPUserFolder (and pal, LDAPUserSatellite) have made >authentication in our Zope setup a pleasure to work with. Yes, you understood perffectly my bad english :-) Thanks, Josef _________________________________________________________________ MSN 8 helps eliminate e-mail viruses. Get 2 months FREE*. http://join.msn.com/?page=features/virus

1 0

Re: audio order
by Nate Aune 07 Jun '04

07 Jun '04

> I am most interested and will check out your efforts. You are welcome to join as a member on the Plone4Artists site. There is also a newsletter and mailing list to make it easier to stay in touch with the developments. http://plone4artists.jazkarta.com > my wiki address (when it is up) is 192.117.110.160:8080/nigunim/thewiki I checked out the wiki, and it looks like you have a very ambitious project indeed! > My problem is that the audio is only one aspect of the picture and I > need to keep the metadata in sync with, notation and information. > > I am currently leaning towards keeping the metadata outside the actual > ogg files and having it added when the playlists are created. Why not keep the metadata in the OGG files themselves. It's in the OGG spec, so you might as well take advantage of it! > First people will search the metadata and then reaquest to hear the > songs. You can store the metadata in the Zope database as well, so that it is searchable. > I unfortuately got all my reponses off list. And I can see that this message you sent to me was also sent privately instead of to the list. You should really use "Reply to All" in your email client, so that BOTH the list and the recipient get a copy of your msg. > Some suggested a way to use the Zope db for large files. Yes, Sergey Volobuev mentioned that Zope 2.7.1 will have some improvements in this area. > I am still so new to zope that I am still unsure what will provide me > with the best solution. You have some pretty special requirements in that you need to keep metadata in sync with audio files and notation files. I would strongly recommend that you have a look at Archetypes. It gives you a lot of flexibility in this area. You could for example extend the ATAudio product to be referenceable to a ATNotation type. In this way, you can upload your Audio files with all metadata intact, and then "link" this audio file to a corresponding Notation file that you have also uploaded. Using WebDAV, you can get these files into your site very quickly by drag-n-drop, and you won't have to enter all the metadata into your site because it will already be embedded in the OGG files. As for the notation, I know that Andrew Kuchling from the docutils project wrote a directive for the ABC music language. http://sourceforge.net/mailarchive/message.php?msg_id=7625994 Michael Hauser is working on getting this to work in a Zope/Plone site, which means you could upload a notation file, and it would be rendered in the site as a PNG image. It looks like the only dependencies besides docutils are abcm2ps, Ghostscript and PIL. Now to reply to your comments... >>> Have you seen the audio products? In what way will they help me? >> >> CMFAudio, written by Marc Bowery is fine for small MP3 files, > > I have small ogg files but lots of them If they are small and Zope 2.7.1 is able to stream them sufficiently, you may not even want to bother with storing them on the file system. There are some advantages to having all your data in the ZODB. >> want to workflow, edit and >> search for them. >> > but not for the general public only a small group of developers You can define these permissions however you want. >> The cool thing is that we've implemented an ID3Storage layer which acts >> as an interface for reading/writing the ID3 tags from/to the MP3 files >> This was done using pyid3lib (http://pyid3lib.sourceforge.net) >> >> This saves you from doing a lot of data-entry, especially if your audio >> files already have metadata embedded in them. >> > In either case the metadata is yet to be added. The question is whether > it should reside withing the ogg files or the notation or ?. Well, that depends on your use cases. You could also make an abstract "Song" type which contains ONLY metadata but has references to the actual audio and notation files. Or if you don't want to bother with Archetypes, you could make this "Song" type folderish, so it could be a container for the audio and notation files. In my opinion, this would be the simplest way to do it. > I also have the language issue where I need to serve metadata in > multiple languages (hebrew and english) Ugh.. Then that complicates things a bit. Currently, the only solution that I know of is I18NLayer, but it gets very messy. If you can wait a month, there will be a new product called LinguaPlone which makes handling multilingual content much easier. However, I think it requires that your content types are Archetypes-based since it relies on the new Archetypes references engine. >> Unless you don't even use Zope to serve the file, but simply provide a >> pointer to the URL where another 3rd party tool (such as Apache, >> Icecast, Shoutcast, Edna, etc.) actually serves up the file. >> > sounds interesting But again, if your OGG files are small, you may not want to complicate matters with 3rd party streaming tools. On the other hand, your solution will be more scalable if you store your files outside of the ZODB because then you can use any streaming server and easily change to a better one if the need arises. >>> Well I think the largest ogg file will be 9 megs. Certainly not 30- 50 >>> meg. 9 Meg is not what I would consider "small". If you are going to have many of these large files, I would definitely consider storing them on the file system instead of the ZODB. Or else you will quickly find yourself with ZODB bloat. >> This is how we do it with ATAudio. When you click on the 'Play' icon, it >> auto-generates an .m3u file which points to the MP3 file being served >> from your Apache server. > Also ogg? I answered this in the last mail. No ogg support yet, but it's coming... >> Jens Klein (jensens) is working on providing support for OGG files, >> using the pyOGG libraries. http://www.andrewchatham.com/pyogg/ >>> I am not planning to run apache in addition to zope. I haven't looked >>> at ZEO and I will do that soon I guess. >> >> Why aren't you planning to run Apache? It's pretty foolish to run Zope >> 'in the wild' without Apache in front of it. Also, Apache (esp. with >> mod_mp3 or Apache::MP3) makes an excellent server for serving up those >> large MP3/OGG files. > > Well I have seen those who use it in the wild as you say and just use a > lot of cache. Well, the Zope caching is not very robust and eats up a lot of RAM. You can reduce the hit on your Zope server a lot by using Apache or Squid caching in front of Zope. Also, using Apache is not only for performance reasons, but also for security reasons. > I may use apache etc. but for development I am working locally. I am > trying presently to avoid learning another thing, at least until I > understand Zope enough to get off the ground. It's fine while you're developing the site, but once you launch it, you should really use Apache. It's not very difficult to set up. Just a few lines in your Apache's httpd.conf file (VirtualHost directive). >>> If anyone is willing/interested in giving some feedback about how to >>> best use zope for my project, My Wiki explains the project details and >>> design issues. >> >> What is the URL to your wiki? Mine is >> http://plone4artists.jazkarta.com/development/Audio >> >> The ATAudio product is still a little rough around the edges, but you >> are welcome to join in the development efforts. > I will take a look thanks. >> >> The bugs/issues collector for ATAudio describes the known issues and >> features which are planned. http://tinyurl.com/37u7k >> >> You can also read the TODO.txt if you grab the product from the >> collective CVS. http://sf.net/projects/collective >> >> I'm looking forward to this talk in a few weeks at the EuroPython >> conference: "The Railroad Project: Managing Large files Around Zope" >> http://www.europython.org/conferences/epc2004/info/talks/zope/kitblake01 >> >> Nate > > Thanks > Aaron > >

4 12

Newbie question: can the ZODB be moved? On a different Server or HDD?
by Shane McCombs 07 Jun '04

07 Jun '04

Newbie question: can the ZODB be moved? On a Server or HDD? We would like to keep the DataBase on a SNAP is this possible? Thank you Shane McCombs Innovation Developer Raymond Building Supply Corp. 239.478.6284

3 2