[Zope-dev] how bad are per-request-write-transactions

Toby Dickenson tdickenson@geminidataloggers.com
Mon, 22 Apr 2002 08:30:31 +0100


On Fri, 19 Apr 2002 07:54:42 -0400, Paul Everitt <paul@zope.com>
wrote:

>This pattern applies better when you have a lot of document cataloging=20
>to be done.  A separate process can wake up, make a ZEO connection, and=20
>process the queue.  I don't think that indexing documents *has* to be a=20
>transactional part of every document save.

Ive used something similar to that in a previous project that didnt
get beyond prototype stage.

>Under this cron-style approach, you also pay less of a conflict-error=20
>penalty, as you can increase the backoff period.

You dont need a 'backoff period' as such; you just move any jobs that
have suffered a conflict further back in the work queue. In some cases
you can almost eliminate ConflictErrors by making the background
process single-threaded.



Toby Dickenson
tdickenson@geminidataloggers.com