16 Apr
2003
16 Apr
'03
2:26 p.m.
On Wednesday 16 April 2003 3:13 pm, Casey Duncan wrote:
The file is divided into 64K chunks, each of which is pickled. Each chunk is unpickled separately and then discarded.
If I remember correctly, chunks are not explicitly discarded. They will certainly stay in memory until the end of the transaction, then the garbage collector will drop the least recently used objects. A 200MB file will certainly cause a 200MB memory surge when downloaded. -- Toby Dickenson http://www.geminidataloggers.com/people/tdickenson