June 2004 - Zope - Zope lists

[Zope] LocalFS - Allow View of Files, Disallow Browse of directories
by Samir Mishra 08 Jun '04

08 Jun '04

Hello all, I'm trying to set up LocalFS folders in Zope that will allow anonymous users to access contents of individual files in the folder, but they will not be able to browse the directory. Something like Apache, and what it does with the icons directory. Thanks. Samir

2 1

Re: [Zope] Link of the Day
by Bert Vanderbauwhede 08 Jun '04

08 Jun '04

On Mon, 7 Jun 2004 09:48:23 -0400, Paul Winkler wrote: > On Mon, Jun 07, 2004 at 11:21:25AM +0200, Bert Vanderbauwhede wrote: > >> The only thing I can conclude, is that the problem is caused by >> requests >> that somehow lock up Zope. These requests come from one or more users >> at the university. > > Just a guess, but maybe there are some local user(s) who are infected > with worms / virii that are DOSing your Zope? That is one of the possibilities. But it doesn't have to be a virus. There is very little > I'd look through your Zope access log and see if it's only the number > of requests that are a problem, or the I was thinking of using the Apache logs to 'replay' the requests of friday, and see if I can recreate the problem. I haven't had time to do it yet. > I've seen on some of my sites that extremely large numbers of requests > to non-existent pages can effectively DOS zope. This is interresting. This can explain what happened when I got all those M$ WebDAV requests. And when I had the same problem two weeks ago, I noticed a whole bunch of requests for Apache error pages, that were proxied to Zope, but which Zope couldn't find of course. > But I've never > found a solution other than waiting for the storm to subside. Too bad. In the case of those M$ WebDAV requests, I was able to locate the users who were causing the trouble and make them stop. But then again, those WebDAV requests were easy to spot in access_log. This time, it's a bit harder. > Another guess: Do you use ZEO? No. Bert Vanderbauwhede... -- "I laugh in the face of danger. Then I hide until it goes away." -- Alexander LaVelle Harris

1 0

Re: [Zope] Re: Updating Caches
by James Cammarata 07 Jun '04

07 Jun '04

(mistakenly sent this to the poster, re-sending it here) using a Cron / Windows Scheduler job it would be trivial to write a script using the Python HTTP module to make periodic requests to your web server from the proxy server. do something like this: #------------------ import httplib conn = httplib.HTTPConnection("your proxy server address here") requestpagelist = ('index.html',....) # all the pages you want cached for page in requestpagelist: conn.request("GET", page) res = conn.getresponse() # do any other processing on the response here conn.close() #------------------ This is basically a 2 second hack of the example code from python.org for the httplib module. Setup a scheduled job (Cron for linux, Scheduler for Windows) and your pages will periodically be grabbed and cached. James Cammarata jimi(a)sngx.net www.sngx.net home: 314-966-5976 work: 314-872-2426 cell: 314-409-0583 ______________________________________________________________ Out the Ethernet, through the router, down the fiber, off another router, down the T1, past the fire-wall ...nothing but Net

1 0

Product for Out-of-Process jobs
by Florian Reiser 07 Jun '04

07 Jun '04

Hello, I need to generate some huge PDF-report out of process. So the user sees some waiting screen, while the report is generated. When generation is finished the report is delivered. First I did it with Threads. It was a pain, but the waiting screen worked. Now I do it with ZEO, but the waiting screen doesn't work any more. I'm now finally thinking about a generic product allowing me to do a task out-of-process. Could someone please tell me how to get things done without threads. I have already read http://www.zopelabs.com/cookbook/1058719806 . But the line pdf = ReportGen().createReport(report()) is a bit cryptic to me. Is someone interested in helping me with this product? With kind regards Florian Reiser

2 3

zope tutorial blues
by aamehl 07 Jun '04

07 Jun '04

Hi all, I am trying to the zope tutorial and I find that It is missing images and subdirectories. Maybe I installed it wrong, or i am indeed missing pieces. I remember starting the tutorial previously and not getting an error that I am missing images etc. Anyone have an idea how to get it up and running? Thanks Aaron

1 1

Touchy APE?
by Anton Stonor 07 Jun '04

07 Jun '04

I've been playing around with Shane's excellent APE (http://hathaway.freezope.org/Software/Ape) Cool concept. However it seems to be a bit more touchy to certain objects than the default ZODB filestorage. In other words: Objects such as Btreefolder2 and Group User Folders work using default ZODB filestorage, but break with APE. Maybe it's just my environment, but on the other hand APE might (on purpose?) be more touchy. So I don't know whether to file this as a bug or not -- or if it's APE's or the other projects fault. Any thoughts? My environment: Windows 2000 Zope 2.7.0 Ape 0.8 (also tried the CVS-version) Ape file storage (also tried Mysql storage) GRUF 2.0.1 BTreeFolder2 1.0 Btreefolder2 traceback: 2004-06-07T20:47:51 ERROR(200) ZODB Couldn't load state for '17' Traceback (most recent call last): File "c:\zopesand\Products\Ape\lib\apelib\zodb3\connection.py", line 359, in setstate event = osio.deserialize(oid, obj, classification, state) File "c:\zopesand\Products\Ape\lib\apelib\core\io.py", line 160, in deserialize mapper.serializer.deserialize(event, state) File "c:\zopesand\Products\Ape\lib\apelib\core\serializers.py", line 102, in deserialize s.deserialize(event, state) File "c:\zopesand\Products\Ape\lib\apelib\zope2\ofsserial.py", line 129, in deserialize obj._initBTrees() File "C:\zopedev\Products\BTreeFolder2\BTreeFolder2.py", line 477, in __getattr__ res = self._tree.get(name) AttributeError: 'NoneType' object has no attribute 'get' ---- GRUF traceback: Traceback (innermost last): * Module ZPublisher.Publish, line 104, in publish * Module Zope.App.startup, line 221, in commit * Module ZODB.Transaction, line 233, in commit * Module ZODB.Transaction, line 348, in _commit_objects * Module apelib.zodb3.connection, line 263, in commit * Module apelib.core.io, line 152, in serialize * Module apelib.core.serializers, line 93, in serialize * Module apelib.zope2.security, line 103, in serialize * Module Products.GroupUserFolder.DynaList, line 24, in __getitem__ * Module Products.GroupUserFolder.GRUFFolder, line 153, in data * Module Products.GroupUserFolder.GRUFFolder, line 186, in userdefined_roles * Module Products.GroupUserFolder.GRUFFolder, line 180, in listGroups AttributeError: Groups /Anton

1 0

Invoking an executable from zope
by Kailashnath_Ganesan 07 Jun '04

07 Jun '04

Hi, I need to invoke an executable file from zope. I am not able to import modules like os or nt in python script. I also tried to use an external method, but am not able to do so. Zope hangs and I am not able to restart it without restarting the machine. Is there any built-in functions in python to accomplish this? Can we do this from zope itself?? Plz explain. Thanks and regards,

3 3

Re: Group mapping not working on LDAPUserFolder
by Josef Albert Meile 07 Jun '04

07 Jun '04

> > 1) We have an extra attribute for the LDAP Schema: > > LDAP Attribute Name: ou > > Friendly Name: group > > Multi-valued: Yes > >This is an unsupported way of storing group membership. > >jens Yes, I know. Actually I didn't set up the LDAP, I'm just using it. Anyway, group mapping should work without that attribute, shouldn't it? Does the page template work for you? Thanks, Josef _________________________________________________________________ The new MSN 8: smart spam protection and 2 months FREE* http://join.msn.com/?page=features/junkmail

2 1

Link of the Day
by Bert Vanderbauwhede 07 Jun '04

07 Jun '04

Last friday, my Zope-site locked up again. The same thing happened to me 9 days before ("Zope locks up", 05/27/2004). I'll try to give more details on what happened. SETUP ===== * RedHat 8 * Apache 2.0.40 * Zope 2.6.4 * Python 2.1.3 * CMF 1.2 Apache and Zope run on separate servers, both Dell PowerEdges. The connection between Apache and Zope is established through RewriteRules and SiteRoots (I'm planning to switch to VirtualHostMonster). I also use Apache for SSL. PERFORMANCE MONITORING ====================== I monitor the performance of the site by checking the number of httpd-threads. When everything is fine, there are about 20 to 23 threads. When this number goes up, the site is slowing down. When the number of threads reaches 150 (the maximum number of threads configured in httpd.conf), the site has locked up. Nothing happens anymore. I run Zope with 4 threads to resolve requests. This should be enough, everybody tells me. But what if some of these threads are waiting for data from external databases. In my case, LDAP was a problem. We used an old version of OpenLDAP (1.2) which had some serious memory leaks. When the load of the LDAP-server started peaking, the number of httpd-threads peaked also. When the load of the LDAP-server went down, the number of httpd-processes went also down. I don't have to do anything, the problem disappears all by itself. THE PROBLEM =========== Friday, suddenly the number of httpd-threads started rising, and soon reached the maximum of 150. The site had locked up. I checked, but the problem was not related to LDAP (as far as I could see). First, there were no load-problems with LDAP. Second, I switched to another LDAP-server, which uses a recent version of OpenLDAP. This version doesn't have those memory leak problems. And the worst part: the problem didn't go away. The performance problems with LDAP usually don't last very long. But this time (and the time before), the problem lasted for hours. INTERLUDE: WEBDAV/MICROSOFT PROBLEMS ==================================== I've had a similar problem about a year ago. My website contains some MS Word-documents. A couple of times, the site locked up when someone tried to download one of those documents. What happened was this: they clicked a link to a Word-document, so it would open immediately in their browser. When this happens, some versions of Microsoft Word keep on sending PROPFIND-requests (PROPFIND is a WebDAV method) to the server (to the http-port, not the WebDAV-port). This caused Zope to slow down, and eventually lock up. I solved this problem by adding a RewriteRule that returned an "403 - Forbidden" when someone sent a WebDAV-request to ports 80 or 443. This solved the problem. THINGS I'VE TRIED ================= * Restarting Zope: This didn't work. Immediately after I've restarted Zope, the number of httpd-threads started rising again. * Switching back to an older Data.fs: I had made some major changes friday, so maybe they were the cause of the problems. I replaced Data.fs by Data.fs from the day before, but it didn't work. The number of httpd-threads rose again. * Using another Zope server: Maybe it's a problem with my Zope server. Luckily, I have another Zope server running, with the same site. I changed httpd.conf, so that requests were forwarded to this other server. The problem didn't go away. * Raising the maximum number of httpd-threads: This was a suggestion of a colleague. I raised the maximum number of threads to 300. This time, the maximum number of threads rose to 300. So the problem didn't go away. * Excluding internal users with iptables: I configured iptables, so that any internal requests (requests from users at the university) were rejected. Immediately, the number of httpd-threads went down to a comfortable 21 (I did not restart Zope or Apache). When I restored iptables, so that internal requests were accepted again, the number of httpd-threads remained at 21. Temporarily excluding local users seemed to have solved the problem. CONCLUSIONS =========== The only thing I can conclude, is that the problem is caused by requests that somehow lock up Zope. These requests come from one or more users at the university. Unfortunately, I can only be sure if the problem happens again. I'm not sure if I want this to happen. I am thinking of using som kind of log replayer, so I can simulate what happened friday with another server. Maybe that way I can see if the requests are indeed the problem. QUESTIONS ========= 1. Is my conclusion correct? 2. What would you do in this situation? Bert Vanderbauwhede... -- "I laugh in the face of danger. Then I hide until it goes away." -- Alexander LaVelle Harris

3 3

Z PDF Document
by Asad Habib 07 Jun '04

07 Jun '04

Hello. Does anyone know how to remove the header and footer lines from a Z PDF document? I set the Header_line_thickness property to 0 as the documentation stated, but this did not get rid of the line altogether but simply gave me a thinner line. Any help would be greatly appreciated. Thanks. - Asad

1 0