[Zope] Efficient Processing Of Large ZCatalog Queries

[Toby Dickenson]

On Thursday 17 Oct 2002 9:48 pm, VanL wrote:
> Hello,
>
> I have a zope setup that does a ZCatalog Query, grabs each item (i.e.,
> it does not use the query-return objects), and then does some processin=
g
> on each returned object.
>
> In pseudocode, whenever I do a ZCatalog Query, I do the following:
>
> return [myFunction(getObject(x)) for x in catalog.search(myquery)]
>
> The problem is that some of the query response will be quite large -- u=
p
> to 10,000 objects returned.  Doing a dtml-in over a result set this siz=
e
> does not seem to be feasible -- the browser times out, for one thing.

Are you sure the time is spent in the dtml, rather than in the pseudocode=
 loop=20
your presented above?