- Zope-Dev - Zope lists

Streaming large files
by Thilo Staebler 09 Jul '04

09 Jul '04

hi! I have to stream large mpeg-files over http with range support. this works quite nice until the client seeks in the (media)player and the files aren't tooooo large, because zope caches the whole file... ...so each seek means streaming the whole file from the requested position till end *g* -> my RESPONSE object doesn't even know, that the player has seeked e.g. back to the beginning... is there a way to bypass the zope caching? and how do I know if the player has disconnected, so I can stop streaming? thanks in advance thilo

4 4

Re: [Zope-dev] Making a ZSQL.DA fully multi-threaded?
by sathya 09 Jul '04

09 Jul '04

sathya wrote: > we have been looking at psycopg for postgres. > zope opens atleast one connection per zope thread. I have obeserved the > same for mysql as well. Are you creating your own threads within zope ? > in which case you have to do the locking yourself > Brad Clements wrote: > >> I am using ZsapdbDA with SAPDB (now MaxDB) and have run into problems >> when Zope has more than one thread. >> >> The folks at SAP suggest that there should be one database connection >> per thread, rather than sharing one connection across threads. >> >> I haven't yet looked at the Zsapdb source, but I think it has only one >> connection for all threads. >> >> Is there a document somewhere that explains how to make variables >> "thread private" in Zope? I vaguely recall something about one cache >> per thread, or that variables are read- >> only shared unless updated by a thread, and then they're copied.. This >> is probably quite wrong, but obviously I just don't understand how >> data and threading works in Zope. >> >> So, I'm looking for a document that explains this clearly. How to have >> data that is not shared between threads (perhaps a kind of connection >> pool thingy). >> >> >> Also, I have other projects where I really want to have just one >> object of it's kind no matter how many threads. For example, gvibDA >> uses Thunked_TM for this, but that doesn't really work with ZSQLDA >> because I've seen that multiple connect calls are made, even with the >> THUNKED_TM. >> >> Is there a "Zen Of" document about this somewhere? >> >> Thanks >> >> >> > >

1 0

TALParser barfing on byte-order marked utf8 XML files.
by Romain Slootmaekers 09 Jul '04

09 Jul '04

Yo, We are using TAL for things other than ZPT. but are having problems with files that include a BOM preamble. the problem is that althought the underlying XML parser is capable of parsing these kind of files, TALParser initialises his parent without encoding (XMLParser.__init__(self) in TALParser.py line 27) Anyway, I have attached a small example (test.py + test.ml) that illustrates the problem with Zope 2.7.1. running the test gives: UnicodeEncodeError: 'ascii' codec can't encode character u'\ufeff' in position 0: ordinal not in range(128) which is perfectly logical: feff (the start of the bom preamble) is not ascii. chipping away the preamble (data=data[4:] ) gives problems further on in the file as the test example has some german characters (ä) UnicodeEncodeError: 'ascii' codec can't encode character u'\xe4' in position 50: ordinal not in range(128) which is also perfectly logical: ä has code 132. My question is simply: why is TALParser not taking the encoding into acount ? Is this deliberate, or is it an oversight ? Romain Slootmaekers. # # # from xml.dom.minidom import parseString import sys from TAL.TALParser import TALParser from TAL.TALInterpreter import TALInterpreter from TAL.DummyEngine import DummyEngine import StringIO import codecs print sys.getdefaultencoding() def readData(): f = open('test.xml','r') readerClass = codecs.getreader('utf8') print readerClass reader = readerClass(f) data = reader.read() f.close() print "size = %s" % len(data) return data def expand(xml): parser = TALParser() xml = xml[4:] parser.parseString(xml) program, macros = parser.getCode() engine = DummyEngine(0) out = StringIO.StringIO() interpreter = TALInterpreter(program,macros,engine,stream=out) interpreter() result = out.getvalue() return result data = readData() expanded = expand(data) document = parseString(expanded) print "ok"

1 0

AccessControl Problems on Mac OSX
by Terry Kerr 08 Jul '04

08 Jul '04

Hi, I seem to be having problems relating to AccessControl on MacOSX. I have a python product which I previously ran in Zope2.4.3/Python 2.1.3 and have upgraded it to run in Zope2.7.1/Python2.3.3. It runs fine on Linux and FreeBSD, however I get this traceback with some actions within the product on Mac OSX 10.1 Module Products.PageTemplates.Expressions, line 201, in __call__ Module Products.PageTemplates.Expressions, line 189, in _eval Module Products.PageTemplates.Expressions, line 145, in _eval __traceback_info__: shopper Module Products.PageTemplates.Expressions, line 340, in restrictedTraverse __traceback_info__: {'path': ['name'], 'TraversalRequestNameStack': []} SystemError: NULL result without error in PyObject_Call I narrowed this down to a guarded_getattr() problem in the AccessControl module. One thing I notice is that there is a C and a Python implementation of the access control stuff. If I explicitly set name='PYTHON' at the beginning of AccessControl/Implementation.py::setImplementation(), my product works fine, so I gather the problem is related to the C implementation. Has anyone experienced any similar problems on MacOSX? I notice this related issue in the zope collector, but it was rejected? http://zope.org/Collectors/Zope/232 Should I add another issue to the collector? terry

2 1

Access Zope objects from python
by Tor Oskar Wilhelmsen 06 Jul '04

06 Jul '04

Hi This question is from a Zope newbie, who gets a little confused when trying to write a product for Zope. My product fetches a lot of picture information, and this information shall be viewed in a fotogallery (the viewer is made as a ZPT) My question is really simple then: When I write this product in python, how could I generate a zope image object of each of the pictures in the db. The part I am interested in is how I can access and create zope objects from python. Which classes do I have to inherit from? -Tor Oskar Wilhelmsen

2 1

Re: [Zope-dev] Zope 2.7.0 and Pythom Image Library
by Tor Oskar Wilhelmsen 05 Jul '04

05 Jul '04

That was my thought to, but it isn't like that. When I run the code from command line, all works perfectly well. The difference in the command line vs zope is that in the command line the from OFS import SimpleItem is ignored, and I use the class gallerybase: instead of #class gallerybase(SimpleItem.Item): Can the import of SimpleItem, and the inheritance of SimpleItem.Item make som errors?? -TOW ----- Original Message ----- From: "Andreas Jung" <ajung(a)zopyx.com> To: "Tor Oskar Wilhelmsen" <toroskar(a)chello.no>; <zope-dev(a)zope.org> Sent: Monday, July 05, 2004 8:33 AM Subject: Re: [Zope-dev] Zope 2.7.0 and Pythom Image Library > If the code works in pure Python then it must work in Zope especially when > you call > the code from an external method or other filesystem-based code as long as > you are using > the same Python version. Your problem looks likely that your input data is > broken. > > -aj > > --On Montag, 5. Juli 2004 8:27 Uhr +0200 Tor Oskar Wilhelmsen > <toroskar(a)chello.no> wrote: > > > Hi > > I'm trying to get the PIL(last version on python 2.3) working with Zope, > > but it seems that it's not working. > > > > I use the code: > > file = StringIO.StringIO(data) > > im = Image.open(file) > > im.show() > > > > where data is datafrom a blob in a db. This code is working outside > > Zope, but at once when i try to make it a product in Zope, I get this > > error: > > > > IOError: cannot identify image file > > > > > > Does anyone know what's wrong or what to do to make this work? > > > > Thanks for all help! > > > > > > Regards > > Tor Oskar Wilhelmsen > > > > Andreas Jung > zopyx.com - Software Development and Consulting Andreas Jung

1 0

INSTANCE_HOME and SOFTWARE_HOME still necessary in 2.7 start script?
by Chris Withers 03 Jul '04

03 Jul '04

Hi there, Is it still necessary to specify INSTANCE_HOME and SOFTWARE_HOME in the start script for Zope? Or would the following work? python /my/path/to/Zope/startup/run.py -C /my/instance/path/zope.conf cheers, Chris -- Simplistix - Content Management, Zope & Python Consulting - http://www.simplistix.co.uk

2 4

Who's experiencing FileStorage corruption?
by Tim Peters 01 Jul '04

01 Jul '04

[follow-ups to zodb-dev(a)zope.org, please] We (Zope Corp) occasionally get reports of FileStorage (Data.fs) corruption of kinds that aren't understood, and that are never seen in Zope Corp's own Zope deployments, neither in extreme artificial stress tests. We take corruption very seriously, and there are no known bugs in the current releases of ZODB that can cause corruption. Therefore we're very keen to investigate cases that may still exist. By "corruption", I mean what corruption conventionally means for any file: the Data.fs and/or Data.fs.index file is damaged at the byte level, as if someone had overwritten some region (or regions) with nonsense bytes. Of course this can be a disaster when it occurs. Visible symptoms may include: + FileStorage.py raises CorruptedDataError. + FileStorage.py passes on this exception from Python's struct module: error: unpack str size does not match format The only currently known causes for these are hardware problems (bad disk, bad disk controller, loose connection, flaky memory chip) and equivalently fatal system software bugs (buggy system disk driver, buggy system I/O libraries, buggy third-party software). If you experience corruption not due to such causes beyond ZODB's control(*), we want to hear about it! The best place to report a case is on the Zope Collector: http://collector.zope.org/Zope with topic "Database". Because database files can be very large, and may contain sensitive data, please don't attach them to the report; you should be willing to let us get copies of them privately, though. (*) How do you know whether the cause is beyond ZODB's control? You probably can't, and that's fine. A case where you can: the last time Jim Fulton tried to track one of these down, the customer's system was in such bad shape that they were unable to make a readable tar file containing their database files: attempts to do so created corrupt *tar* files. If I/O on your system is plain broken, then no, FileStorage isn't going to work either.

1 0

How do you open mounted databases on startup in 2.7?
by Chris Withers 30 Jun '04

30 Jun '04

In 2.6, with DBTab, I had something like: [Storage: Packed] type=ClientStorage addr=zeo://localhost:6001 storage=packed cache_size=100000000 [Database: Packed] cache_size=4000 mount_paths=/somepath open_at_startup=1 The closest I can get in 2.7 is: <zodb_db packed> <zeoclient> server 127.0.0.1:6001 storage packed cache-size 100000000 wait on </zeoclient> mount-point /content cache-size 4000 </zodb_db> What do I use instead of open_at_startup or has this functionality vanished in 2.7? cheers, Chris -- Simplistix - Content Management, Zope & Python Consulting - http://www.simplistix.co.uk

1 0

Weird AssertionError on History Compare in Zope 2.7.1 PythonScript
by Chris Withers 30 Jun '04

30 Jun '04

Hi, I upgraded a Zope 2.6.2 site to 2.7.1. Since then, the history tab of all my old Script(Python)'s is broken. If I try to do a compare between two versions, or just view a historical revision, I get the following error: 2004-06-30T17:41:22 ERROR(200) SiteError http://localhost:8001/myScript/HistoricalRevisions/848.5934.59436.15445 Traceback (most recent call last): File "e:\Zope\2.7.1\lib\python\ZPublisher\Publish.py", line 92, in publish object=request.traverse(path, validated_hook=validated_hook) File "e:\Zope\2.7.1\lib\python\ZPublisher\BaseRequest.py", line 328, in traver se try: subobject=object[entry_name] File "e:\Zope\2.7.1\lib\python\OFS\History.py", line 67, in __getitem__ rev=historicalRevision(self, serial) File "e:\Zope\2.7.1\lib\python\OFS\History.py", line 52, in historicalRevision rev.__setstate__(state) File "e:\Zope\2.7.1\lib\python\Products\PythonScripts\PythonScript.py", line 2 17, in __setstate__ self._body = body + '\n' File "E:\Zope\2.7.1\lib\python\ZODB\Connection.py", line 534, in register assert object._p_jar is self Script (Python)'s I've created since the upgrade are fine, but any old ones that were around have a buggered history. I figure this is a bug of some sort, but thought I'd ask here too. The bug report is at: http://zope.org/Collectors/Zope/1394 ...if anyone would prefer to follow up in the collector... Chris -- Simplistix - Content Management, Zope & Python Consulting - http://www.simplistix.co.uk

2 2