[Zope] searching and serving large textfiles ~120 Mb

[Peter Sabaini]

Stefan H. Holek wrote:
> FWIW, ExtFile only serves one chunk at a time and does not load the 
> entire file into RAM. Don't know about LocalFS though.
> 
> Stefan


Not true. ExtFile-1.1.3 *does* load the whole file into RAM prior to 
serving it. Take a look at ExtFile.index_html() -- the file gets loaded 
into an StringIO object and then the contents of this StringIO object 
are returned.

That doesn't matter for smaller files, but serving eg. videos like this 
could be getting expensive. Try it -- load a 500Mb AVI and watch your 
mem usage soar :-)

  - peter.


> On Freitag, Dez 5, 2003, at 19:28 Europe/Vienna, Peter Sabaini wrote:
> 
>> Hm, I think (downloading) performance should be roughly the same -- 
>> after all, the files would still have to loaded by Zope, at least with 
>> Products like LocalFS and ExtFile that first load the whole file into 
>> memory before starting to serve it? I wrote myself a streaming method 
>> for this reason.
>>
> -- 
> The time has come to start talking about whether the emperor is as well
> dressed as we are supposed to think he is.               /Pete McBreen/
> 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/x-pkcs7-signature
Size: 3461 bytes
Desc: S/MIME Cryptographic Signature
Url : http://lists.zope.org/pipermail/zope/attachments/20031209/033d957e/smime.bin