[Zope-dev] Re: New testrunner on the Zope 2 trunk.

[Tres Seaver]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Jim Fulton wrote:
> 
> I just checked in a new test runner on the trunk.  It is mostly backward
> compatible with the old test runner.  You can get help on the test
> runner by running
> it with -h.  There is more extensive documentation in
> lib/python/zope/testing/testrunner.txt.
> 
> Note that the new test runner complains if test_suite functions don't
> return
> test suites.  There is a zope.i18n test suite that it currently
> complains about.
> Unfortunately, I can't just fix this because it is an svn:external and
> it will be too painful to create a tag with the necessary fix in the short
> term.  I expect we will be integrating a newer version of Zope 3 later
> in the
> week and we'll take care of this then.

I'm seeing test failures out of the self-tests for the new testrunner:


Failure in test
/home/tseaver/projects/Zope-CVS/Zope-SVN-trunk/lib/python/zope/testing/testrunner-coverage.txt
Failed doctest test for testrunner-coverage.txt
  File
"/home/tseaver/projects/Zope-CVS/Zope-SVN-trunk/lib/python/zope/testing/testrunner-coverage.txt",
line 0

- ----------------------------------------------------------------------
File
"/home/tseaver/projects/Zope-CVS/Zope-SVN-trunk/lib/python/zope/testing/testrunner-coverage.txt",
line 20, in testrunner-coverage.txt
Failed example:
    testrunner.run(defaults)
Expected:
    Running unit tests:
    ...
    lines   cov%   module   (path)
    ... testrunner.py)
    ...
Got:
    Running unit tests:
      Ran 192 tests with 0 failures and 0 errors in N.NNN seconds.
    Running samplelayers.Layer1 tests:
      Set up samplelayers.Layer1 in N.NNN seconds.
      Ran 9 tests with 0 failures and 0 errors in N.NNN seconds.
    Running samplelayers.Layer11 tests:
      Set up samplelayers.Layer11 in N.NNN seconds.
      Ran 34 tests with 0 failures and 0 errors in N.NNN seconds.
    Running samplelayers.Layer111 tests:
      Set up samplelayers.Layerx in N.NNN seconds.
      Set up samplelayers.Layer111 in N.NNN seconds.
      Ran 34 tests with 0 failures and 0 errors in N.NNN seconds.
    Running samplelayers.Layer112 tests:
      Tear down samplelayers.Layer111 in N.NNN seconds.
      Set up samplelayers.Layer112 in N.NNN seconds.
      Ran 34 tests with 0 failures and 0 errors in N.NNN seconds.
    Running samplelayers.Layer12 tests:
      Tear down samplelayers.Layer112 in N.NNN seconds.
      Tear down samplelayers.Layerx in N.NNN seconds.
      Tear down samplelayers.Layer11 in N.NNN seconds.
      Set up samplelayers.Layer12 in N.NNN seconds.
      Ran 34 tests with 0 failures and 0 errors in N.NNN seconds.
    Running samplelayers.Layer121 tests:
      Set up samplelayers.Layer121 in N.NNN seconds.
      Ran 34 tests with 0 failures and 0 errors in N.NNN seconds.
    Running samplelayers.Layer122 tests:
      Tear down samplelayers.Layer121 in N.NNN seconds.
      Set up samplelayers.Layer122 in N.NNN seconds.
      Ran 34 tests with 0 failures and 0 errors in N.NNN seconds.
    Tearing down left over layers:
      Tear down samplelayers.Layer122 in N.NNN seconds.
      Tear down samplelayers.Layer12 in N.NNN seconds.
      Tear down samplelayers.Layer1 in N.NNN seconds.
    Total: 405 tests, 0 failures, 0 errors
    False
- ----------------------------------------------------------------------
File
"/home/tseaver/projects/Zope-CVS/Zope-SVN-trunk/lib/python/zope/testing/testrunner-coverage.txt",
line 30, in testrunner-coverage.txt
Failed example:
    os.path.exists('coverage_dir')
Expected:
    True
Got:
    False
- ----------------------------------------------------------------------
File
"/home/tseaver/projects/Zope-CVS/Zope-SVN-trunk/lib/python/zope/testing/testrunner-coverage.txt",
line 32, in testrunner-coverage.txt
Failed example:
    os.listdir('coverage_dir')
Exception raised:
    Traceback (most recent call last):
      File
"/home/tseaver/projects/Zope-CVS/Zope-SVN-trunk/lib/python/zope/testing/doctest.py",
line 1256, in __run
        compileflags, 1) in test.globs
      File "<doctest testrunner-coverage.txt[7]>", line 1, in ?
    OSError: [Errno 2] No such file or directory: 'coverage_dir'
- ----------------------------------------------------------------------
File
"/home/tseaver/projects/Zope-CVS/Zope-SVN-trunk/lib/python/zope/testing/testrunner-coverage.txt",
line 38, in testrunner-coverage.txt
Failed example:
    shutil.rmtree('coverage_dir')
Exception raised:
    Traceback (most recent call last):
      File
"/home/tseaver/projects/Zope-CVS/Zope-SVN-trunk/lib/python/zope/testing/doctest.py",
line 1256, in __run
        compileflags, 1) in test.globs
      File "<doctest testrunner-coverage.txt[9]>", line 1, in ?
      File "/home/tseaver/projects/Zope-CVS/lib/python2.3/shutil.py",
line 142, in rmtree
        raise exc[0], (exc[1][0], exc[1][1] + ' removing '+arg)
    OSError: [Errno 2] No such file or directory removing coverage_dir

..............
    ..................................................
    ..
  Ran 7352 tests with 1 failures and 0 errors in 329.098 seconds.







Tres.
- --
===================================================================
Tres Seaver          +1 202-558-7113          tseaver at palladion.com
Palladion Software   "Excellence by Design"    http://palladion.com
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.1 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org

iD8DBQFDX3nh+gerLs4ltQ4RAnGmAJ9aNNuYiu9l0CIP19iS9UFFAkZsGwCg1zxx
u1f3+8LRfQvX7qI4ktbHTw8=
=R1zX
-----END PGP SIGNATURE-----