[Zope-dev] choice of test runner...

[Tres Seaver]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Martijn Faassen wrote:
> Chris Withers wrote:
>> Wichert Akkerman wrote:
>>> I would like to see a move away from zope testing frameworks to a more
>>> standard testing infrastructure: setup.py test, possibly combined with
>>> using nose.
>> I'd love to see a side-by-side feature comparison of the major python 
>> test discovering and runner frameworks. It would then be interesting to 
>> see if there's a compelling enough reason for The Zope Framework 
>> steering committee to make a pronouncement on which one to use...
> 
> My initial reaction is that the zope.testrunner is enormously 
> featureful, we're using quite a few of those features, and it's being 
> actively maintained. I think going to nose would be a lot of work 
> without compelling new features, and I see little gain in that.
> 
> I would like setup.py test to be supported somehow if possible. I 
> believe some people have done experiments with this. Tres, do you have 
> any experience with this?

I got the ZODB and transaction tests running via the 'eggsupport' module
I added to the testrunner::

- ------------------------- 8< -------------------------------
$ svn co $ZSVN/transaction/trunk transaction-trunk
A    transaction-trunk/LICENSE.txt
...
 U   transaction-trunk
Checked out revision 97781.
$ cd transaction-trunk/
$ ../bin/python2.6 setup.py test
running test
Checking .pth file support in .
/home/tseaver/projects/Zope-CVS/transaction-trunk/../bin/python2.6 -E -c
pass
Searching for zope.interface
Reading http://pypi.python.org/simple/zope.interface/
Best match: zope.interface 3.5.0
Downloading
http://pypi.python.org/packages/source/z/zope.interface/zope.interface-3.5.0.zip#md5=478d05add7cd7faf25a2fd880a739ddb
Processing zope.interface-3.5.0.zip
Running zope.interface-3.5.0/setup.py -q bdist_egg --dist-dir
/tmp/easy_install-ANScFf/zope.interface-3.5.0/egg-dist-tmp-ut5t2S

Installed
/home/tseaver/projects/Zope-CVS/transaction-trunk/zope.interface-3.5.0-py2.6-linux-i686.egg
Searching for zope.testing
Reading http://pypi.python.org/simple/zope.testing/
Reading http://svn.zope.org/zope.testing
Best match: zope.testing 3.7.1
Downloading
http://pypi.python.org/packages/source/z/zope.testing/zope.testing-3.7.1.tar.gz#md5=23e9389228c79f4343e6b299d7d51fc0
Processing zope.testing-3.7.1.tar.gz
Running zope.testing-3.7.1/setup.py -q bdist_egg --dist-dir
/tmp/easy_install-uZFmax/zope.testing-3.7.1/egg-dist-tmp-T243K9

Installed
/home/tseaver/projects/Zope-CVS/transaction-trunk/zope.testing-3.7.1-py2.6.egg
running egg_info
creating transaction.egg-info
writing requirements to transaction.egg-info/requires.txt
writing transaction.egg-info/PKG-INFO
writing top-level names to transaction.egg-info/top_level.txt
writing dependency_links to transaction.egg-info/dependency_links.txt
writing entry points to transaction.egg-info/entry_points.txt
writing manifest file 'transaction.egg-info/SOURCES.txt'
writing manifest file 'transaction.egg-info/SOURCES.txt'
running build_ext
Doctest: transaction.tests.test_SampleResourceManager.ResourceManager ... ok
Doctest:
transaction.tests.test_SampleResourceManager.ResourceManager.savepoint
... ok
Doctest:
transaction.tests.test_SampleResourceManager.ResourceManager.tpc_abort
... ok
Doctest:
transaction.tests.test_SampleResourceManager.ResourceManager.tpc_begin
... ok
Doctest:
transaction.tests.test_SampleResourceManager.ResourceManager.tpc_finish
... ok
Doctest: transaction.tests.test_SampleDataManager.DataManager ... ok
Doctest: transaction.tests.test_SampleDataManager.DataManager.abort ... ok
Doctest: transaction.tests.test_SampleDataManager.DataManager.commit ... ok
Doctest: transaction.tests.test_SampleDataManager.DataManager.prepare ... ok
Doctest: transaction.tests.test_SampleDataManager.DataManager.savepoint
... ok
Doctest: transaction.tests.test_register_compat ... ok
test_as_weakref_list (transaction.tests.test_weakset.WeakSetTests) ... ok
test_contains (transaction.tests.test_weakset.WeakSetTests) ... ok
test_len (transaction.tests.test_weakset.WeakSetTests) ... ok
test_map (transaction.tests.test_weakset.WeakSetTests) ... ok
test_remove (transaction.tests.test_weakset.WeakSetTests) ... ok
testExceptionInAbort
(transaction.tests.test_transaction.TransactionTests) ... No handlers
could be found for logger "txn.-1209874240"
ok
testExceptionInCommit
(transaction.tests.test_transaction.TransactionTests) ... ok
testExceptionInTpcAbort
(transaction.tests.test_transaction.TransactionTests) ... ok
testExceptionInTpcBegin
(transaction.tests.test_transaction.TransactionTests) ... ok
testExceptionInTpcVote
(transaction.tests.test_transaction.TransactionTests) ... ok
testNSJTransactionAbort
(transaction.tests.test_transaction.TransactionTests) ... ok
testNSJTransactionCommit
(transaction.tests.test_transaction.TransactionTests) ... ok
testTransactionAbort
(transaction.tests.test_transaction.TransactionTests) ... ok
testTransactionCommit
(transaction.tests.test_transaction.TransactionTests) ... ok
testTransactionNote
(transaction.tests.test_transaction.TransactionTests) ... ok
Doctest: doom.txt ... ok
Doctest: transaction.tests.test_transaction.test_addAfterCommitHook ... ok
Doctest: transaction.tests.test_transaction.test_addBeforeCommitHook ... ok
Doctest: transaction.tests.test_transaction.test_join ... ok
testExceptionInAbort
(transaction.tests.test_transaction.TransactionTests) ... ok
testExceptionInCommit
(transaction.tests.test_transaction.TransactionTests) ... ok
testExceptionInTpcAbort
(transaction.tests.test_transaction.TransactionTests) ... ok
testExceptionInTpcBegin
(transaction.tests.test_transaction.TransactionTests) ... ok
testExceptionInTpcVote
(transaction.tests.test_transaction.TransactionTests) ... ok
testNSJTransactionAbort
(transaction.tests.test_transaction.TransactionTests) ... ok
testNSJTransactionCommit
(transaction.tests.test_transaction.TransactionTests) ... ok
testTransactionAbort
(transaction.tests.test_transaction.TransactionTests) ... ok
testTransactionCommit
(transaction.tests.test_transaction.TransactionTests) ... ok
testTransactionNote
(transaction.tests.test_transaction.TransactionTests) ... ok
Doctest: savepoint.txt ... ok
Doctest:
transaction.tests.test_savepoint.testRollbackRollsbackDataManagersThatJoinedLater
... ok

- ----------------------------------------------------------------------
Ran 42 tests in 0.152s

OK
- ------------------------- 8< -------------------------------


Tres.
- --
===================================================================
Tres Seaver          +1 540-429-0999          tseaver at palladion.com
Palladion Software   "Excellence by Design"    http://palladion.com
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFJtfCw+gerLs4ltQ4RAg3MAKCOvUqhZI35mnaJmtIMjiPDzqwxKACgg5zx
ftN/qty034FaqEoacdUShDU=
=BHCQ
-----END PGP SIGNATURE-----