[Zope] Efficient Processing Of Large ZCatalog Queries

[VanL]

Yes, the time is spent in the pseudocode loop, not in the dtml.  Sorry 
that wasn't clearer.  However, the dtml waits for the loop to completely 
finish processing before it will display the result page.  One of the 
things that I am curious about is a method to display the results as 
they become available.  (As I noted in the original message, 
REQUEST.RESPONSE.write doesn't seem to be working for me in my current 
setup.

Thanks,

Van

Toby Dickenson wrote:

>On Thursday 17 Oct 2002 9:48 pm, VanL wrote:
>  
>
>>Hello,
>>
>>I have a zope setup that does a ZCatalog Query, grabs each item (i.e.,
>>it does not use the query-return objects), and then does some processing
>>on each returned object.
>>
>>In pseudocode, whenever I do a ZCatalog Query, I do the following:
>>
>>return [myFunction(getObject(x)) for x in catalog.search(myquery)]
>>
>>The problem is that some of the query response will be quite large -- up
>>to 10,000 objects returned.  Doing a dtml-in over a result set this size
>>does not seem to be feasible -- the browser times out, for one thing.
>>    
>>
>
>Are you sure the time is spent in the dtml, rather than in the pseudocode loop 
>your presented above?
>
>
>  
>