March 2007 - Zope - Zope lists

Re: [Zope] Download Large Files in Zope
by Maciej Wisniowski 07 Mar '07

07 Mar '07

> > I don't understand your paste. > I'll try to describe better my situation > > - server A with Apache(80) and a rewrite rule to Zope(8080) > - server B with a shared folder "storage" - *without any webserver* > - server C with MS SQL Server - *without any webserver* - connected > with ZODBC > - firewall that send any incoming connection for www.mydomain.it to > server A when protocol is http or https > - in every server is active a ZOPEUSER (local administrator) with the > same password. > > An incoming request to download will cause: > - server A ask server C for filename > - server A ask server B for file (using LocalFS object that stay in > ZODB linked to server B's shared folder) > > I really can't understand how implement the same process using Apache > for file storage. Please stay on zope list too! I've never used tramline, but after reading short description on their page seems that you'll have simpler configuration: - server A with Apache(and tramline) and a rewrite rule to Zope(8080) - server C with MS SQL Server - *without any webserver* - connected with ZODBC - firewall that send any incoming connection for www.mydomain.it to server A when protocol is http or https In general seems that instead of real, large files, app server receives only small files that contain only unique identifiers of these real ones. Real files are handled by tramline and stored in specific filesystem folders. When someone requests a file for download, application server sets special header that contains unique file identifier and this causes that tramline will return real, big file to the browser. Upload similarly uses headers to allow or disallow uploading. -- Maciej Wisniowski

2 3

Download Large Files in Zope
by jbusato＠libero.it 07 Mar '07

07 Mar '07

Hi, I've just installed Zope 2.8 with Apache 2 and I made a download library (a CMS site is too much for me and I can't find a simple "download area" product, so I've done it!) Now, when I click on a large .exe file link (href) it seems it load all data before prompt for download and the zope service memory usage grow until 1/2 Gb. How can i manage downloads & uploads? Thank you in advance Illorca ------------------------------------------------------ Con Prometeo prestiti senza spese fino a 31.000 Euro! http://click.libero.it/webnation06marz07

5 10

database connection in script
by javi lopez 07 Mar '07

07 Mar '07

how to create a database connection in a script python????

3 4

form-script-zsql
by javi lopez 07 Mar '07

07 Mar '07

I´m doing a form with username and email, these values go script python and with a zsql method inside script, it stored in DB I have a zpt with a form I have a script python:: Connection DB:: db_system_type = REQUEST.get('db_system_type', 'mysql') from Products.ZMySQLDA import DA DA.manage_addZMySQLConnection(self, db_conn_id, '', REQUEST.get('db_conn_str', 'zzz@localhost zzz zzz')) #now i have to do zsql method to store the values in DB how can i do it??? Can you help me???Thanks When I fill in the form and i push "send" button, it store username and email in DB

2 1

Zope hangs in FreeBSD with plenty of memory and CPU resources
by Jean Lagarde 07 Mar '07

07 Mar '07

All, As a coincidence, that hang of Zope I mentioned in a message I posted yesterday has happened again today (second time), after a planned reboot. So here is a completely different issue from the memory one we've been discussing today. There was other weirdness (for whatever reason _mysql could not find libmysqlclient_r.so.15 on some restart attempts), but here is something that seemed to occur consistently while Zope was unresponsive: On FreeBSD 5.4, with zserver-threads set to the default 4, there were seven Zope threads with the following states (CPU use is 0% and memory use is well below the maximum, pretty much where it is at after a normal fresh Zope restart): select ksesig kserel kqread kqread kqread kqread When Zope is operating normally and idle, I generally only see the three top threads, and when serving pages, I rarely see more than three threads; one actually often disappears and I only see two, one in the RUN state. I know that the kqread state has to do with the kqueue or kevent system call, and assume that Zope being in that waiting state for a long time is abnormal. Asking here in case someone has seen this behavior before and knows what might be the cause. As for the last and only other time this happened, Zope regained normal behavior by itself after a little while (in the order of half an hour). I don't see anything abnormal in the event log (other than the _mysql issue I mentioned above), and while stuck, requests do not register in the Z2.log. Browsers do get a connection because they state "waiting for..." but they do not receive anything, not even headers. After a fresh restart, I could get Zope to respond to a relatively benign request (the top level ZMI page), while there were only three Zope threads, but if asking for more, Zope would quickly get to the unresponsive state described above. We're thinking that we may be having underlying OS issues and will probably ask on a FreeBSD list and/or upgrade FreebBSD and hope that helps, but I'm asking here first just in case that this pattern of behavior was observed and resolved before. Cheers, Jean

4 4

Zope Patch for Zeo Client Connection.py
by Paul Williams 06 Mar '07

06 Mar '07

Hi Everyone, We were experience problems with our zeo client setup on redhat rhel4. The client would just quit responding. No memory or cpu increase was associated with this. The client would remain hung until it was restarted. We looked on the client using Netstat and the status was ESTABLISHED with the zeo server. On the zeo server the netstat said LISTENING. When running the deadlockdebugger, one thread was in asnycore wait. The others were normal actions such as folder listing or folder contents. We implemented a couple of lines of code on line 641 of connection.py in the ZEO/zrpc packages We added and else clause to call self.close() if delay is over one second. We found that one second wasn't quite enough and moved it to 5 seconds. Now we find out that this drastically improved our performance. The servers are now < 1 second per page load. Before, they could be 5 seconds or more, if they loaded at all. Also, our servers used to crash several times a day and they now haven't crashed in almost a week. I just wanted to put this out there and see if anyone has any comments at all. I need to get a more permenant solution than this, but it is what we have for now. Thank you, Paul Williams

2 1

Zope hangs and Python eats all memory
by Nico Grubert 06 Mar '07

06 Mar '07

Dear list members, I am running Zope 2.9.6. on a 64-Bit Suse Linux 10.1 machine (9 Gbyte of RAM) with Python 2.4.3. installed. From time to time, Zope hangs and I cannot access it anymore. I tried to use the "Zope DeadlockDebugger" but if my Zope hangs I cannot call the URL "http://myzopesite:8080/manage_debug_threads?secret_password" to let Zope DeadlockDebugger show any useful information. Zope does not response. If Zope hangs, the python process eats all the memory and the machine starts to swap. The "top" command in the shell tells me: ------------------------------------------------------------------------- Tasks: 91 total, 2 running, 89 sleeping, 0 stopped, 0 zombie Cpu(s): 10.4%us, 0.4%sy, 0.0%ni, 89.0%id, 0.2%wa, 0.0%hi, 0.0%si Mem: 9041256k total, 9025124k used, 16132k free, 10604k buffers Swap: 4208988k total, 4208988k used, 0k free, 9472k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 29992 wwwrun 16 0 12.0g 8.3g 2860 S 19 95.9 3:52.66 python ------------------------------------------------------------------------- There are several add-ons for Zope installed, like: - "Psycopg" Postgres Database Adapter - "mxODBCDA" ODBC Database Adapter - LDAPUserfolder - "Silva" Content Management System - PIL Furthermore, I see a lot of Conflict Errors in the "event.log" like e.g.: ------------------------------------------------------------------------- ZPublisher.Conflict ConflictError at /VirtualHostBase/http/193.134.202.20:80/mysite/VirtualHostRoot/: database conflict error (oid 0x0435, class BTrees._OOBTree.OOBTree, serial this txn started with 0x036aeb14ab1c4b88 2007-01-15 12:04:40.104030, serial currently committed 0x036aeb1d0cc5d099 2007-01-15 12:13:02.993605) (80 conflicts (0 unresolved) since startup at Mon Jan 15 11:44:55 2007) ------------------------------------------------------------------------- These kind of Conflict errors occur almost every minute. It might be that these errors have something to do with it but I am not sure. How can I figure out what exactly causes Zope to hang? If you need more information, please let me know. Thanks in advance... Regards, Nico

6 12

Problem On Rebuild
by tonylabarbara＠aol.com 05 Mar '07

05 Mar '07

Hi; I'm building out a new server and trying to import all the functionality from the old OS-corrupted server. The Web site built on this server have a directory structure that's easy for identifying stuff but makes for long URLS: example.com/dir1/dir2/dir3/dir4/index.pt They're always the same dirs and they appear on every page of every site. The sysadmin before me had a neat little script buried somewhere that made those dirs disappear when they posted to a browser. That's important for SEO, since the SEs only go a couple dirs deep. But I'll be darned if I know where this guy put that script! I tried to tarball his old Zope build-out and unpack and use it, but I got this error: Error: The object named by "DBTab.ClassFactories.autoClassFactory" could not be imported Traceback (most recent call last): File "/usr/local/zope/278/lib/python/Zope/Startup/datatypes.py", line 106, in importable_name package = __import__(n, g, g, component) File "/usr/local/zope/278/lib/python/DBTab/ClassFactories.py", line 18, in ? import OFS.Uninstalled File "/usr/local/zope/278/lib/python/OFS/__init__.py", line 14, in ? import Products.ReplaceSupport.AdvancedPatch File "/usr/local/zope/instance1/Products/ReplaceSupport/__init__.py", line 17, in ? import Handlers File "/usr/local/zope/instance1/Products/ReplaceSupport/Handlers/__init__.py", line 30, in ? from Globals import package_home File "/usr/local/zope/278/lib/python/Globals.py", line 23, in ? import Acquisition, ComputedAttribute, App.PersistentExtra, os File "/usr/local/zope/278/lib/python/App/PersistentExtra.py", line 14, in ? from class_init import default__class_init__ File "/usr/local/zope/278/lib/python/App/class_init.py", line 14, in ? from AccessControl.PermissionRole import PermissionRole File "/usr/local/zope/278/lib/python/AccessControl/__init__.py", line 16, in ? import DTML File "/usr/local/zope/278/lib/python/AccessControl/DTML.py", line 18, in ? from DocumentTemplate import DT_Util File "/usr/local/zope/278/lib/python/DocumentTemplate/__init__.py", line 22, in ? from DocumentTemplate import String, File, HTML, HTMLDefault, HTMLFile File "/usr/local/zope/278/lib/python/DocumentTemplate/DocumentTemplate.py", line 112, in ? from DT_String import String, File File "/usr/local/zope/278/lib/python/DocumentTemplate/DT_String.py", line 17, in ? from DT_Util import ParseError, InstanceDict, TemplateDict, render_blocks, str File "/usr/local/zope/278/lib/python/DocumentTemplate/DT_Util.py", line 42, in ? from cDocumentTemplate import InstanceDict, TemplateDict, \ ImportError: /usr/local/zope/278/lib/python/DocumentTemplate/cDocumentTemplate.so: Undefined symbol "PyUnicodeUCS2_DecodeLatin1" I'm not sure if I should even be trying that, but I thought maybe he put the script in there, since I can't find it as a prod. or anything else through the ZCMI. Ideas? TIA, Tony ________________________________________________________________________ AOL now offers free email to everyone. Find out more about what's free from AOL at AOL.com.

4 6

repeating folder in url
by Thomas Bennett 05 Mar '07

05 Mar '07

I know this has been addressed before but after searching the WEB half a day Friday I only found one related item although not directly related to my situation and it said search the archives. Zope Version (Zope 2.6.1 (binary release, python 2.1, linux2-x86), python 2.1.3, linux2) Python Version 2.1.3 (#1, Sep 19 2002, 13:15:46) [GCC egcs-2.91.66 19990314/Linux (egcs-1.1.2 release)] System Platform linux2 (I am moving everything to a new server and upgrading all software this week) Situation: These URLs all show the same content although there is only one dir1 folder: /dir1/ /dir1/dir1/ /dir1/dir1/dir1/ My thoughts have been its related UnrestrictedTraversal, acquisition, or something else but not sure where to change or if it can be changed? I've seen this before but it has pretty much been a non issue but now the campus is setting up a Google Search Appliance and the indexing mechanism seems to be attempting to traverse this pattern into infinite recursion. Since beginning this email I have found a contributing issue: In a directory say /dir1/dir2/dir3 a page in dir3 has a relative link to ../dir2. This may be the issue totally but is there an easy way to prevent this from performing as Zope allows it to, aside from horse whipping the person that created that page. Thanks, Thomas -- ==================================================================== Thomas McMillan Grant Bennett Appalachian State University Computer Consultant III P O Box 32026 University Library Boone, North Carolina 28608 (828) 262 6587 If it's not as simple as possible to try it, then the barrier to entry is too high. Library Systems Help Desk: http://www.library.appstate.edu/help/ ====================================================================

3 2

Zope modules
by Ron Miller 05 Mar '07

05 Mar '07

Hi, We just installed Zope 2.10, but we're not seeing Versions as an option in the product Add drop-down list. The Pearl Script option is not there either. What do we need to do to get these on the list? The Zope Book indicates that these come standard with the base product. Do we need to install a different version? Or add some modules, if so, from where? Any help would be appreciated. Thanks, -- Ron Miller

3 2