[Zope] ZCatalog Performance problem

[Dieter Maurer]

Jonathan Hobbs wrote at 2004-9-16 11:44 -0400:
>I am trying to install a new version of our database and have encountered
>some performance problems. We are using:
> ...
>        2    0.000    0.000   11.462    5.731 Catalog.py:717(searchResults)
>        2    2.069    1.035   11.461    5.730 Catalog.py:446(search)
>        1    0.216    0.216    9.320     9.320
>OkapiIndex.py:120(_search_wids)
> ...

As you can see, most of the time is spend in "_search_wids".

> ...
>        1    0.216    0.216    9.320     9.320
>OkapiIndex.py:120(_search_wids)
>     2085    0.239    0.000    9.174    0.004 Connection.py:499(setstate)

And it spends most of the time in "Connection...setstate".

This indicates poor persistency design.

To find out what goes wrong, you would need an instrumentation
of the load process. I recently posted my instrumentation
of "ZEO.ServerStub". Maybe, you do something similar for
FileStorage?


An alternative could be to look at the code of
"OkapiIndex..._search_wids". Apparently, it loads to many
persistent objects.

-- 
Dieter