[Zope-dev] z3c.testsetup test faliure (was Re: Zope Tests: 55 OK, 18 Failed)

[Christophe Combelles]

> Hi Christophe,
>
> Christophe Combelles wrote:
>
> [snip: z3c.testsetup test errors on bluebream]
>>
>> thanks!! There is only one remaining error on Python 2.4 now. It seems related
>> to an 'encoding' argument added to DocFileSuite in python 2.5, and used in
>> zope.app.testing
>
> Oh, missed that. This is more tricky but I'll have a look into it.
> Thanks for the hint (and the buildbots revealing such nasty problems)!

Thanks for releasing 0.8.1. It seemed to fix it!

However I have a weird problem: builders were all green, then I suddenly had 
repeated failures with 0.8.1 on all the builders, then I've tried to launch the 
tests by myself directly in the builder, and tests passed, without changing 
anything... Then if I relaunch the builder alone, tests pass:
http://buildbot.afpy.org/bluebream/waterfall

Is there a possibility that tests fail when several builders run at the same time?




File 
"/home/ccomb/buildout-eggs/z3c.testsetup-0.8.1-py2.6.egg/z3c/testsetup/README.txt", 
line 110, in README.txt
Failed example:
     testrunner.run(defaults)
Differences (ndiff with -expected +actual):
     - Running z3c...layer.DefaultZCMLLayer [...ftesting.zcml] tests:
     -   Set up z3c...layer.DefaultZCMLLayer [...ftesting.zcml] in N.NNN seconds.
     + Running z3c.testsetup.functional.layer.DefaultZCMLLayer 
[/home/ccomb/buildout-eggs/z3c.testsetup-0.8.1-py2.6.egg/z3c/testsetup/tests/othercave/ftesting.zcml] 
tests:
     +   Set up z3c.testsetup.functional.layer.DefaultZCMLLayer 
[/home/ccomb/buildout-eggs/z3c.testsetup-0.8.1-py2.6.egg/z3c/testsetup/tests/othercave/ftesting.zcml] 
in N.NNN seconds.
         Ran 3 tests with 0 failures and 0 errors in N.NNN seconds.
     - Running z3c...layer.DefaultZCMLLayer [...ftesting2.zcml] tests:
     -   Tear down z3c...layer.DefaultZCMLLayer [...ftesting.zcml] ... not supported
     + Running z3c.testsetup.functional.layer.DefaultZCMLLayer 
[/home/ccomb/buildout-eggs/z3c.testsetup-0.8.1-py2.6.egg/z3c/testsetup/tests/othercave/ftesting2.zcml] 
tests:
     +   Tear down z3c.testsetup.functional.layer.DefaultZCMLLayer 
[/home/ccomb/buildout-eggs/z3c.testsetup-0.8.1-py2.6.egg/z3c/testsetup/tests/othercave/ftesting.zcml] 
... not supported
         Running in a subprocess.
     -   Set up z3c...layer.DefaultZCMLLayer [...ftesting2.zcml] in N.NNN seconds.
     +   Set up z3c.testsetup.functional.layer.DefaultZCMLLayer 
[/home/ccomb/buildout-eggs/z3c.testsetup-0.8.1-py2.6.egg/z3c/testsetup/tests/othercave/ftesting2.zcml] 
in N.NNN seconds.
         Ran 1 tests with 0 failures and 0 errors in N.NNN seconds.
     -   Tear down z3c...layer.DefaultZCMLLayer [...ftesting2.zcml] ... not 
supported
     +   Tear down z3c.testsetup.functional.layer.DefaultZCMLLayer 
[/home/ccomb/buildout-eggs/z3c.testsetup-0.8.1-py2.6.egg/z3c/testsetup/tests/othercave/ftesting2.zcml] 
... not supported
       Running z3c.testsetup.tests.othercave.testing.FunctionalLayer1 tests:
         Running in a subprocess.
         Set up z3c.testsetup.tests.othercave.testing.FunctionalLayer1 in N.NNN 
seconds.
         Ran 1 tests with 0 failures and 0 errors in N.NNN seconds.
         Tear down z3c.testsetup.tests.othercave.testing.FunctionalLayer1 in 
N.NNN seconds.
       Running z3c.testsetup.tests.othercave.testing.UnitLayer2 tests:
         Running in a subprocess.
         Set up z3c.testsetup.tests.othercave.testing.UnitLayer1 in N.NNN seconds.
         Set up z3c.testsetup.tests.othercave.testing.UnitLayer2 in N.NNN seconds.
           Running testSetUp of UnitLayer1
           Running testSetUp of UnitLayer2
           Running testTearDown of UnitLayer2
           Running testTearDown of UnitLayer1
         Ran 1 tests with 0 failures and 0 errors in N.NNN seconds.
         Tear down z3c.testsetup.tests.othercave.testing.UnitLayer2 in N.NNN 
seconds.
         Tear down z3c.testsetup.tests.othercave.testing.UnitLayer1 in N.NNN 
seconds.
     - Running zope...testrunner.layer.UnitTests tests:
     ?              ^
     + Running zope.testing.testrunner.layer.UnitTests tests:
     ?              ^^^^^^^
         Running in a subprocess.
     -   Set up zope...testrunner.layer.UnitTests in N.NNN seconds.
     ?               ^
     +   Set up zope.testing.testrunner.layer.UnitTests in N.NNN seconds.
     ?               ^^^^^^^
     -     Custom setUp for  <DocTest doctest05.txt from ...doctest05.txt:0 (2 
examples)>
     -     Custom tearDown for  <DocTest doctest05.txt from ...doctest05.txt:0 
(2 examples)>
     +     Custom setUp for  <DocTest doctest05.txt from 
/home/ccomb/buildout-eggs/z3c.testsetup-0.8.1-py2.6.egg/z3c/testsetup/tests/othercave/doctest05.txt:0 
(2 examples)>
     +     Custom tearDown for  <DocTest doctest05.txt from 
/home/ccomb/buildout-eggs/z3c.testsetup-0.8.1-py2.6.egg/z3c/testsetup/tests/othercave/doctest05.txt:0 
(2 examples)>
         Ran 4 tests with 0 failures and 0 errors in N.NNN seconds.
     -   Tear down zope...testrunner.layer.UnitTests in N.NNN seconds.
     ?                  ^
     +   Tear down zope.testing.testrunner.layer.UnitTests in N.NNN seconds.
     ?                  ^^^^^^^
     - Total: 10 tests, 0 failures, 0 errors in N.NNN seconds.
     + Total: 10 tests, 0 failures, 0 errors in 1 minutes N.NNN seconds.
     ?                                         ++++++++++
       False


>
> Best regards,
>