[Zope-dev] unit test policy questions

[Marius Gedminas]

On Thu, Jul 29, 2010 at 02:52:36PM +0200, yuppie wrote:
> Hi Martin!
> 
> 
> Martin Aspeli wrote:
> > On 29 July 2010 20:14, yuppie<y.2010 at wcm-solutions.de>  wrote:
> >> Martin Aspeli wrote:
> >>> I never do either. I install zc.recipe.testrunner in a buildout and
> >>> use bin/test, which picks up tests in modules automatically.
> >>
> >> Sure. But do you always run all tests it picks up while working on a
> >> specific test file? Or do you use bin/test with options that allow to
> >> run specific files?
> >
> > See the -s and -t options. :)
> 
> Well. It's not that simple. Today I tried to modify 
> Products.GenericSetup.tests.test_tool using CMF.buildout/trunk.
> 
> I usually use the -m option, but that doesn't work in CMF.buildout 
> because it already uses that option.

Ouch.  Not a good idea, in my book.

> So I tried to execute the module and noticed that's currently broken.
> 
> The -s option doesn't allow to run a specific module.
> 
> And if I use the -t option (-ttest_tool), most tests fail :(

That is an indication that the tests aren't independent.  I would
consider such a test suite to be broken.

Marius Gedminas
-- 
http://pov.lt/ -- Zope 3/BlueBream consulting and development
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 198 bytes
Desc: Digital signature
Url : http://mail.zope.org/pipermail/zope-dev/attachments/20100729/5dabd060/attachment-0001.bin