[Zope-dev] Zope server speed

[Matthew T. Kromer]

Hi Alessandro,

Zope and Python combined aren't too bad if you write some wrappers that help
you manipulate data; the problem comes about when you try to do large naive
queries -- there is a LOT of overhead in taking Oracle data, encapsulating
it in Python objects, and then wrapping that in the Zope machinery.

I have a sample database in Oracle of US Zip codes -- it has about 45,000
records in it.  I can pull this into DCOracle2 on the C adapter side
(dco2.so) in less than a second.  However, wrapping each result cell in a
python object blows that up into about 9 seconds.  If I were to iterate over
the whole thing in Zope (which I haven't timed) it would get a LOT longer,
because Zope is enforcing policy on every object accessed.

So, one of the ways to make that go faster is to use python modules
'outside' of Zope (ie external methods) to perform large calculations which
takes a ZOracleDA connection object to get a cursor object on the database,
does the query directly, and formats and returns the results.

I realize this isn't ideal, but Zope is not optimized for the case of
"extract thousands of records from the database and format them in a huge
table."  Zope likes "extract hundreds of records from the database and
format them in a big table" instead.

With each release, Zope has more features that enable you to program through
the web, but when you're doing performance intensive calculations, it's
usually time to write a python module and plug it in to zope (via an
external method, or by writing a product).  If you have the time to learn, I
suggest the product route as being more satisfying, but it can be more
frustrating as well.


----- Original Message -----
From: "MANOTTI Alessandro" <alessandro.manotti@bfeurope.com>
To: <zope-dev@zope.org>
Sent: Thursday, December 06, 2001 8:52 AM
Subject: [Zope-dev] Zope server speed


>
> > HI all,
> >
> > I have a problem:
> >
> > my company is looking for an application server. I know Zope (I
presented
> > it), and a friend of mine presented Macromedia ColdFusion.
> >
> > We made some tests about the speed of the systems, arghh!!! Zope is VERY
> > slow compared to ColdFusion!
> >
> > Some examples:
> >
> > I used Zope with DCOracle2 drivers to connect and extract 257000 (yes!
it
> > is a test... two hundred fiftyseven thousand records!) and Zope took
more
> > than 10 minutes, since I stopped it after that time (call SQL and print
> > data via <dtml-var ... > TAG).
> >
> > The same PC, the same server, ColdFusion took about 2 minutes to
complete
> > the operation!!!
> >
> > Coldfusion is more than 5 times faster than Zope!!!
> >
> > PHASE 2:
> >
> > I said: ok, maybe Zope is slower that Coldfusion in TAG formatting...
and
> > I tried to get the records and perform a calculation, without no
output...
> >
> > Sigh! the results are the same!
> >
> > I am depressed, since I talk about Zope very well in my company, but
> > now...
> >
> > Coldfusion and Zope are similar, so we shall select ColdFusion to
develop
> > web applications.
> >
> > SIGH !!!
> >
> > Can I try something to increase Zope power?!
> >
> >
> > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >
> > Alessandro Manotti
> > Presidente dell'Associazione "RIUSA"
> >
> > Sito web:     http://riusa.apritisesamo.net
> > email:        riusa@email.it
> > mailing-list: riusa-ml@yahoogroups.com
> >
> >
>
> _______________________________________________
> Zope-Dev maillist  -  Zope-Dev@zope.org
> http://lists.zope.org/mailman/listinfo/zope-dev
> **  No cross posts or HTML encoding!  **
> (Related lists -
>  http://lists.zope.org/mailman/listinfo/zope-announce
>  http://lists.zope.org/mailman/listinfo/zope )
>